Authoring and Monitoring for the emerging 3D immersive Broadcast Audio formats


Anthony Wilkins TV-Bay Magazine
Read ezine online
by Anthony Wilkins
Issue 107 - November 2015

The world of broadcast audio is on the verge of a major revolution. Numerous 3D Immersive formats are under development and will find their way into the mainstream of broadcast production and distribution in the near future. Unlike the world of relatively constrained channel based coding as we are accustomed to (most commonly Left / Right for Stereo and Left / Centre / Right / Surround Left / Surround Right + LFE or Low Frequency Effects for surround), these new codecs will support more channels and/or object based audio coding. For the end consumer, there will be two major benefits from this new approach, a greater sense of involvement or immersion, and a degree of personalisation.

Greater involvement will come from an increased channel count typically by the addition of overhead height channels. Several proponents including the MPEG-H Alliance (Fraunhofer IIS, Technicolor and Qualcomm), Dolby and DTS have successfully demonstrated broadcast compatible systems based on 5.1.4 or 7.1.4 layouts where 4 overhead speakers have augmented the traditional 6 or 8 floor level speakers. This creates a 3D sound image where the viewer or listener is immersed in audio in all dimensions.

Object based audio will give the end user the option to personalise their experience by selecting from a number of audio sources and controlling the level and maybe even the position in the mix. In object based audio, an object is essentially an audio stream with accompanying descriptive metadata. The metadata carries information about where the engineer placed the object in the mix and at what level, and is used to re-create, or render, the audio experience for the end user. Objects may be static and placed at a fixed point in the mix (for example dialog) or dynamic where they are panned across the 3 dimensional soundscape (maybe a plane flying overhead). Depending on restrictions and limitations decided at the point of content creation (and signaled in the descriptive metadata), the end user could select which audio source(s) they want to hear from an on-screen list and perhaps vary the level at which they are reproduced. Think of a sporting event where the options could include home or away commentary, crowd sounds, the referee or match officials voice or pitch side microphones at team ball games. At motor racing events examples could be commentary, drivers voice or pit crew communication.

Does this mean multiple speakers need to be installed to avail of these new benefits? Not necessarily, although of course the best experience will result from a full installation of discrete speakers at both floor level and overhead, however where this is not practical (most likely the majority of typical domestic situations), the final renderer will re-create the mix as accurately as possible based on the actual number and location of speakers the end user has. An increasing number of Soundbars that are designed to sit underneath a display are already available to create a surround experience without consuming valuable space. Better still, a wall mounted Soundframe completely surrounds the display and can give an incredibly realistic reproduction from the height channels.

What does this all mean for the broadcaster? A complete re-build of existing facilities and a total re-think about the audio processing equipment required for outside broadcast vehicles? Well, if we get it right, it should entail just relatively minimal changes to overall workflow and hardware, but inevitably some additions to production and distribution equipment. In the case of object based audio, the metadata appropriate for the final codec needs to be created and added to the audio for insertion into a conventional SDI stream, and the engineer needs to be able to monitor this complex mix (and all the potential downmix variations) to ensure that the distribution chain is fed with all available objects correctly. Loudness levels should also be considered in respect of existing standards and there should be provision for local insertion of content at any point in the chain. Although this all sounds somewhat futuristic, the fact is that the broadcast industry is already seriously considering the potential adoption of these concepts. At Jnger Audio we have already worked closely with Fraunhofer IIS to design a prototype Multichannel Monitoring and Authoring unit (MMA) that is capable of directly interfacing with existing mixing consoles via AES, SDI, MADI, Dante or even analog audio formats. At NAB 2015 there was a comprehensive demonstration of a complete object audio based end-to-end broadcast chain including the original outside broadcast capture, distribution via the network operation centre, insertion of local content from an affiliate station and finally reception at the end-users home with full control of object selection and audio reproduction via Soundframe. At all stages of the distribution chain, the audio could be monitored to verify metadata parameters, downmix(s) could be auditioned and loudness levels could be checked and corrected if required.

Although that particular demonstration was using the MPEG-H codec, it is important to understand that the monitoring and authoring unit is agnostic, or independent, of the final codec used for transmission. Such a device would be easily adaptable to create and monitor metadata for any of the existing or future 3D Immersive formats irrespective of vendor or developer.

www.jungeraudio.com

Tags: iss107 | broadcast audio | 3d immersive formats | facilities | equipment | authoring | monitoring | Anthony Wilkins
Contributing Author Anthony Wilkins

Read this article in the tv-bay digital magazine
Article Copyright tv-bay limited. All trademarks recognised.
Reproduction of the content strictly prohibited without written consent.

Related Interviews
  • Infinity Arm - Matthews Studio Equipment at NAB 2016

    Infinity Arm - Matthews Studio Equipment at NAB 2016

  • K-tek Stingray range shown at NAB 2019

    K-tek Stingray range shown at NAB 2019

  • Cineline Fluid Head from Miller Camera Support at NAB 2014

    Cineline Fluid Head from Miller Camera Support at NAB 2014

  • Belfast TOUR

    Belfast TOUR

  • Miranda on BroadcastShow LIVE at IBC 2013

    Miranda on BroadcastShow LIVE at IBC 2013

  • Tektronix at IBC 2013

    Tektronix at IBC 2013

  • Thear Technology at BVE 2013

    Thear Technology at BVE 2013

  • Guntermann and Drunck GmbH at BVE 2013

    Guntermann and Drunck GmbH at BVE 2013

  • Bexel at NAB 2012

    Bexel at NAB 2012

  • Thear Technology Limited at ProVideo2011

    Thear Technology Limited at ProVideo2011

  • Mediaproxy LogServer for compliance monitoring and analysis at NAB 2019

    Mediaproxy LogServer for compliance monitoring and analysis at NAB 2019

  • Glensound 4 x Loudspeaker monitoring subrack at BVE 2019

    Glensound 4 x Loudspeaker monitoring subrack at BVE 2019

  • JVC monitoring solutions DT-G, DT-E, DT-U, and DT-V range at BVE 2018

    JVC monitoring solutions DT-G, DT-E, DT-U, and DT-V range at BVE 2018

  • IP, 3G-SDI + HDR generation, analysis and monitoring from Phabrix NAB 2017

    IP, 3G-SDI + HDR generation, analysis and monitoring from Phabrix NAB 2017

  • Apantac monitoring over IP at NAB 2016

    Apantac monitoring over IP at NAB 2016

  • Wohler MPEG Monitoring Series at IBC 2014

    Wohler MPEG Monitoring Series at IBC 2014

  • Wohler MPEG Monitoring at BVE 2014

    Wohler MPEG Monitoring at BVE 2014

  • Bridge Technologies QoE Monitoring with Mobile Videowall Display at IBC 2013

    Bridge Technologies QoE Monitoring with Mobile Videowall Display at IBC 2013

  • The Telos Alliance at IBC 2016

    The Telos Alliance at IBC 2016

  • Wohler at IBC 2016

    Wohler at IBC 2016

  • Phabrix Qx at IBC 2015

    Phabrix Qx at IBC 2015

  • Phabrix TAG and Rx at IBC 2015

    Phabrix TAG and Rx at IBC 2015

  • NUGEN Audio at BVE 2015

    NUGEN Audio at BVE 2015

  • Phabrix RX series at IBC 2014

    Phabrix RX series at IBC 2014

  • Volicon Products at IBC 2014

    Volicon Products at IBC 2014

  • Volicon at IBC 2014

    Volicon at IBC 2014

  • Wohler DPP at BVE 2014

    Wohler DPP at BVE 2014

  • Wohler Technologies on BroadcastShow LIVE at IBC 2013

    Wohler Technologies on BroadcastShow LIVE at IBC 2013

  • Volicon on BroadcastShow LIVE at IBC 2013

    Volicon on BroadcastShow LIVE at IBC 2013

  • Calrec Callisto at IBC 2013

    Calrec Callisto at IBC 2013

  • Bridge Technologies PocketProbe App at NAB 2013

    Bridge Technologies PocketProbe App at NAB 2013

  • Sound Devices at NAB 2013

    Sound Devices at NAB 2013

  • TSL Products at NAB 2013

    TSL Products at NAB 2013

  • TSL Systems at BVE 2013

    TSL Systems at BVE 2013

  • TSL Products at BVE 2013

    TSL Products at BVE 2013

  • Oxygen DCT at BVE North 2012

    Oxygen DCT at BVE North 2012

  • RTW at NAB 2012

    RTW at NAB 2012

  • TSL at NAB 2012

    TSL at NAB 2012

  • Qualis at NAB 2012

    Qualis at NAB 2012

  • Digital Nirvana at NAB 2012

    Digital Nirvana at NAB 2012

  • Leader at IBC2011

    Leader at IBC2011

  • Murraypro at IBC2011

    Murraypro at IBC2011

  • DK Technology at IBC2011

    DK Technology at IBC2011


Related Shows
  • Sony monitoring at BVE with Den Lennie

    Sony monitoring at BVE with Den Lennie


Articles
Streaming - Shut up and Sit Down
Matt Lees Twilight Imperium is a board game all about strategy and backstabbing. Known for its length of gameplay, the team behind Shut Up and Sit Down decided to deliver a mammoth 10-hour live broadcast, streamed to Twitch. Matt Lees is here to tell us how it went down.
Tags: iss136 | streaming | blackmagic | atem | 4k | canon c100 | sony pxw-z90 | Matt Lees
Contributing Author Matt Lees Click to read or download PDF
State of the Nation - Drama
Dick Hobbs - new If you can remember as far back as the 1980s, then you probably remember a Saturday night drama called Hill Street Blues, written and developed by Steven Bochco. Made for NBC in the States, it was widely shown around the world, including in the UK.
Tags: iss136 | drama holby city | night manager | netflix | bbc | ai | streaming | podcast | Dick Hobbs - new
Contributing Author Dick Hobbs - new Click to read or download PDF
Looking for the Silver Lining
Harry Grinling According to the World Meteorological Organisation, there are 10 different types of cloud, each of which can be divided further into sub-types. They range from the cirrus, the thin floaty clouds which generally serve only to make the sky look beautiful to the towering, all-embracing cumulonimbus which can deliver fearful quantities of rain – the biggest cumulonimbus clouds can contain 50 million tonnes of water.
Tags: iss136 | cloud | lto | archive | storage | Harry Grinling
Contributing Author Harry Grinling Click to read or download PDF
The way forward in a changing world
Alan Wheable The broadcast and media industries are evolving in all areas to adapt to the challenges of competition from OTT, changing user viewing habits, technological advances in image resolution, dynamic range and colour rendition as well as embracing new video over IP infrastructures.
Tags: iss136 | omnitek | aims | ip | smpte | 2110 | 4k qc | ultra xr | nmos | ultra tq | Alan Wheable
Contributing Author Alan Wheable Click to read or download PDF
NAB Intelligence
Bruce Devlin - new It's that time of year again. 06:30 on road bikes on the Las Vegas Strip with a merry bunch of folks who believe they look good in lycra. As we pedal West up the hill towards Red Rock there will be stories of the year just gone and questions about what to look for at the show. I, for one, will be attending the Devoncroft event to check up on who is spending what and where. I will then look forward to the topics that might be buzzing around the halls. I predict there will be many displays of Machine Learning hiding under the banner of Artificial Intelligence. Some of these will show better picture quality, others will show personalisation engines, some will be improved search tools and yet more will be synthesising pictures and motions to replace reality with and Artificial reality that's more compelling for the viewer.
Tags: iss136 | nab | class | ai | smpte | st2110 | imf | Bruce Devlin - new
Contributing Author Bruce Devlin - new Click to read or download PDF