Somewhere down the latency river


Ben Hawker TV-Bay Magazine
Read ezine online

Some people have been, understandably, getting fairly excited over the prospect of being able to deploy wireless cameras to capture and transmit 4K UHD. Manufacturers and developers are closing in on the ability to deliver systems that will offer up almost endless creative options at the highest – to date – possible picture quality.

But they’re not there yet. There is one pesky hurdle to overcome and, oddly, although it’s a low one, it’s not low enough…and may be the toughest to surmount.

Latency.

Latency is the last remaining barrier to making 4K over RF a widely deployable option. Although manufacturers and developers are investing a lot of effort and resources into reducing latency and are making considerable progress - it’s not yet where it needs to be, but I have no doubt they will continue to drive latency down

And that’s because, for live television, latency is a major issue. You can get away with a certain amount of latency in a sub-4K world. It’s done every day by simply introducing a certain amount of audio delay. Broadcasters can cope with that, but it still makes wireless HD and especially 4K UHD over RF a significant challenge. Sure. It can and is being done, but it still requires a trade-off, and it’s a fairly major one. Viewers, particularly the exploding demographic of those taking advantage of streaming services, are turning away from the annoyance of buffering, delays, and poor quality, all of which are largely down to latency issues.

The current consensus is that the lowest latency that can be consistently achieved is around 100ms. As I said, broadcasters can deal with that without too much of a problem. But to my knowledge no one has really hit the mark to get the delay down to where it’s truly usable for everyday live action.

One company claims to have achieved 75ms, but in order to get it down that far, further compromises have to be made. A lot of picture information has to be thrown out, and in my view, that’s “too much information”.

The throw out factor – for want of a better term - is usually down to the encoding. To speed up encoding, you have to sacrifice quality, which for live action at higher resolutions is unacceptable, as is the inherent delay.

I’ve experimented with the wireless transmitter options on offer to date. They all use the same chipset. Early versions had a delay of more than 1.2 seconds, which is not particularly useful for anything other than, for example, beauty shots from a helicopter that can just be cut into a programme. In applications such as that it works well and delivers acceptable pictures, but it’s not far off what you could already do with older SD radio cameras. In terms of cutting in live shots, the delay can be slightly noticeable but only if you’re a professional deliberately looking for it.

But in higher resolutions it’s just not good enough. One UK broadcaster did a test at a professional football ground with original chipset encoders. On a monitor we watched a footballer strike a ball, then suddenly saw the ball careening toward the opposite goal - and nothing in between, not even the pitch.

That’s clearly too much delay, even for a novice.

New techniques, improved chipsets, and clever encoding algorithms will no doubt continue to reduce latency. There are limits to what existing chipsets can handle, but newer chipsets are always being developed, although perhaps not as rapidly as in the recent past.

RF equipment manufacturers and, for that matter, hire companies, are always pushing for those encoding and latency improvements, but to achieve those goals, the conundrum of sacrificing information and, therefore, quality, for speed still remains. It just comes down to what individual manufacturers can come up with in their codecs, and what portions of emerging professional standards they choose to embrace or discard.

Another question is, I suppose, somewhat subjective. At what point do viewers notice the delay or quality drop? Does ultra-high quality matter? And which judges are more important? The 60 or so people in a truck or studio, or the 60 million sitting at home, on a train, on a bus – pretty much anywhere these days? Where do you draw the line? What, in the end, is the low-latency limit?

Before I get too hypothetical, let’s take a step back and get practical for a moment. Basically, I think the quality versus speed question is almost moot when it comes to UHD 4K, at least at the moment.

When I talk to various customers today, what they want in wireless RF has nothing to do with 4K, progressive video, or anything like that. What they want more than anything are creative options.

Some broadcasters argue that quality has to adhere to the highest accepted standards of established broadcasters, then quite happily settle for less, sometimes without even realising it. I’ve seen entire programmes broadcast that originated from camera feeds several MBs below a minimum acceptable standard, and no one knew the difference. So, if few, if any, notice the difference, is a push for lower latency by sacrificing quality worth pursuing?

Yes.

As I said earlier, consumers are becoming more savvy, and decidedly less tolerant. If they don’t like the channel or platform they’re using due to poor quality or incessant delays, they simply go to one of thousands of other options. Yes, they may not get the content they were seeking, but chances are they’ll find something else that interests them just as much, if not more. Another pair of eyeballs lost, quite often for good. So it’s in everyone’s interests to chase the low-latency/high quality dragon – as long as it makes sense to pursue it. Improvements will no doubt arrive in a combination of improved chipsets, advanced codecs, and new standards in due course, but I would posit that once you get to a certain level, you’re sawing sawdust.

Miniaturisation, on the other hand - already pretty well-established and improving all the time – is what really hits the sweet spot with cameramen and producers, so long as acceptable quality can be maintained. As I said earlier, they want creative options, and reliable, miniaturised transmitters give them exactly that, and more.

The ability to attach a camera transmitter to a helmet, hat, chest, or even strapped to the back of an eagle or whale opens up brave new worlds. A 4K transmitter, in and of itself, is not necessarily a selling point. Users are far more interested in something that’s compact, reliable, and with the lowest latency possible, so they take viewers places they’ve never been before.

So, lower latency with improved miniaturisation is a winning combination that is already delivering exciting new options for HD productions. When it becomes viable for live 4K UHD productions, who knows what we might see next. But for now, it’s more about where you’re going than what it’s going to look like when you get there.

However, if you can couple ultra-low, unnoticeable latency with high quality, that’s the Holy Grail, and it’s what will make the journey worthwhile.

We’re just not there, yet.


Tags: iss129 | latency | 4k | wireless | rf | presteigne | Ben Hawker
Contributing Author Ben Hawker

Read this article in the tv-bay digital magazine
Article Copyright tv-bay limited. All trademarks recognised.
Reproduction of the content strictly prohibited without written consent.

Related Interviews
  • Wireless 4k transmission from BOXX TV at NAB 2019

    Wireless 4k transmission from BOXX TV at NAB 2019

  • Boxx TV Wireless 4K Sub-Frame Breakthrough at NAB 2019

    Boxx TV Wireless 4K Sub-Frame Breakthrough at NAB 2019

  • Teradek demonstrates the Bolt 4K Wireless Video System at NAB2019

    Teradek demonstrates the Bolt 4K Wireless Video System at NAB2019

  • Wireless 4K Transmitter from DTC Domo Broadcast at IBC 2017

    Wireless 4K Transmitter from DTC Domo Broadcast at IBC 2017

  • Apantac UHD 4k Multiviewer at NAB 2019

    Apantac UHD 4k Multiviewer at NAB 2019

  • ADDERLink Infinity 4000 4k KVM at NAB 2019

    ADDERLink Infinity 4000 4k KVM at NAB 2019

  • Compact 4k Cameras CE420-CS, CV506 and CV503 from Marshall at NAB 2019

    Compact 4k Cameras CE420-CS, CV506 and CV503 from Marshall at NAB 2019

  • Lynx Technik Evie 4k HDR to SDR Conversion at NAB 2019

    Lynx Technik Evie 4k HDR to SDR Conversion at NAB 2019

  • Matrox Unveils Monarch EDGE 4K Contribution Encoder at IBC 2018

    Matrox Unveils Monarch EDGE 4K Contribution Encoder at IBC 2018

  • 12G 4K microMUSA Jackfield and Fibre Termination Solutions from Canford at IBC 2018

    12G 4K microMUSA Jackfield and Fibre Termination Solutions from Canford at IBC 2018

  • Blackmagic Design Pocket Cinema Camera BMPCC 4K at IBC 2018

    Blackmagic Design Pocket Cinema Camera BMPCC 4K at IBC 2018

  • Apantac 4k UHD HDMI/DVI Multiviewer with KVM at IBC 2018

    Apantac 4k UHD HDMI/DVI Multiviewer with KVM at IBC 2018

  • JVC 4K Connected Camera GY-HC550 and 500 at IBC 2018

    JVC 4K Connected Camera GY-HC550 and 500 at IBC 2018

  • IMT Vislink HCAM 4k UHD transmitter at IBC 2018

    IMT Vislink HCAM 4k UHD transmitter at IBC 2018

  • Blackmagic Pocket Cinema Camera 4K at NAB 2018

    Blackmagic Pocket Cinema Camera 4K at NAB 2018

  • Blackmagic ATEM Television Studio Pro 4K at NAB 2018

    Blackmagic ATEM Television Studio Pro 4K at NAB 2018

  • 4K UHD Multi-viewer HDMI 2.0 from Apantac at NAB 2018

    4K UHD Multi-viewer HDMI 2.0 from Apantac at NAB 2018

  • Omnitek Updates for Ultra 4k Toolbox at NAB 2018

    Omnitek Updates for Ultra 4k Toolbox at NAB 2018

  • 4k and HEVC with Garland at BVE 2018

    4k and HEVC with Garland at BVE 2018

  • 6K Sony Venice and Sony 4k Palm Camcorders at IBC 2017

    6K Sony Venice and Sony 4k Palm Camcorders at IBC 2017

  • JVC 4K UHD Monitors at IBC 2017

    JVC 4K UHD Monitors at IBC 2017

  • The CFU5 4k Transmitter from Vislink at IBC 2017

    The CFU5 4k Transmitter from Vislink at IBC 2017

  • AJA Thunderbolt 3 IO 4k Plus at IBC 2017

    AJA Thunderbolt 3 IO 4k Plus at IBC 2017

  • HDR, 12G, 4k, IP - the range expands from Phabrix at NAB 2017

    HDR, 12G, 4k, IP - the range expands from Phabrix at NAB 2017

  • Quad 4k Capture and Stream with Maevex from Matrox at NAB 2017

    Quad 4k Capture and Stream with Maevex from Matrox at NAB 2017

  • 4k 60 Matrix from GDSYS at NAB 2017

    4k 60 Matrix from GDSYS at NAB 2017

  • HEVC 4k Encoding from Aviwest at NAB 2017

    HEVC 4k Encoding from Aviwest at NAB 2017

  • Apantac 4k live demo at NAB 2016

    Apantac 4k live demo at NAB 2016

  • Omnitek Ultra 4K Tool Box at IBC 2015

    Omnitek Ultra 4K Tool Box at IBC 2015

  • Snell Advanced Media (SAM) 4k workflow at IBC 2015

    Snell Advanced Media (SAM) 4k workflow at IBC 2015

  • MULTIDYNE Silverback 4k at NAB 2015

    MULTIDYNE Silverback 4k at NAB 2015

  • Atomos talking 4K on BroadcastShow LIVE at IBC 2013

    Atomos talking 4K on BroadcastShow LIVE at IBC 2013

  • Snell Kahuna Production Switcher at IBC 2014

    Snell Kahuna Production Switcher at IBC 2014

  • Snell on BroadcastShow LIVE at IBC 2013

    Snell on BroadcastShow LIVE at IBC 2013

  • Apantac Mi-16 UHD Multiviewer at NAB 2019

    Apantac Mi-16 UHD Multiviewer at NAB 2019

  • Panasonic Lumix GH5 at BVE 2017

    Panasonic Lumix GH5 at BVE 2017

  • Garland at BVE 2017

    Garland at BVE 2017

  • Ikegami 8k camera at IBC 2016

    Ikegami 8k camera at IBC 2016

  • Ikegami HQLM-3120W monitor at IBC 2016

    Ikegami HQLM-3120W monitor at IBC 2016

  • Ikegami UHK-430 camera at IBC 2016

    Ikegami UHK-430 camera at IBC 2016

  • Video Devices PIX-E at IBC 2016

    Video Devices PIX-E at IBC 2016

  • Sound Devices Wingman app at IBC 2016

    Sound Devices Wingman app at IBC 2016

  • JVC GY-LS300 at IBC 2015

    JVC GY-LS300 at IBC 2015

  • AVIWEST at IBC 2015

    AVIWEST at IBC 2015

  • BBright at IBC 2015

    BBright at IBC 2015

  • Thomson Video Networks at IBC 2015

    Thomson Video Networks at IBC 2015

  • Lynx Technik at IBC 2015

    Lynx Technik at IBC 2015

  • JVC at BVE 2015

    JVC at BVE 2015

  • Grass Valley at BVE 2015

    Grass Valley at BVE 2015

  • Gearhouse Broadcast at BVE 2015

    Gearhouse Broadcast at BVE 2015

  • KITPLUS rig setup at IBC 2014

    KITPLUS rig setup at IBC 2014

  • Tektronix at IBC 2014

    Tektronix at IBC 2014

  • Cooke Optics technology at IBC 2014

    Cooke Optics technology at IBC 2014

  • Cooke Optics talk anamorphic at IBC 2014

    Cooke Optics talk anamorphic at IBC 2014

  • JVC GY-LS300 prototype at IBC 2014

    JVC GY-LS300 prototype at IBC 2014

  • MultiDyne SilverBACK at IBC 2014

    MultiDyne SilverBACK at IBC 2014

  • BBright at IBC 2014

    BBright at IBC 2014

  • Hitachi at IBC 2014

    Hitachi at IBC 2014

  • Guntermann and Drunck DP-HR range at IBC 2014

    Guntermann and Drunck DP-HR range at IBC 2014

  • Ateme at IBC 2014

    Ateme at IBC 2014

  • Quantel LiveTouch at IBC 2014

    Quantel LiveTouch at IBC 2014

  • Quantel deal with AFP at IBC 2014

    Quantel deal with AFP at IBC 2014

  • Matrox Monarch HD at NAB 2014

    Matrox Monarch HD at NAB 2014

  • Elemental Technologies Software-Defined Video at NAB 2014

    Elemental Technologies Software-Defined Video at NAB 2014

  • Elemental Technologies HEVC solutions at NAB 2014

    Elemental Technologies HEVC solutions at NAB 2014

  • Elemental Technologies Multiscreen Solutions at NAB 2014

    Elemental Technologies Multiscreen Solutions at NAB 2014

  • Guntermann and Drunck at NAB 2014

    Guntermann and Drunck at NAB 2014

  • Matrox Mojito at NAB 2014

    Matrox Mojito at NAB 2014

  • Matrox Capture Card at NAB 2014

    Matrox Capture Card at NAB 2014

  • Blackmagic URSA at NAB 2014

    Blackmagic URSA at NAB 2014

  • Blackmagic Studio Camera at NAB 2014

    Blackmagic Studio Camera at NAB 2014

  • Cintel Film Scanner: Blackmagic Design at NAB 2014

    Cintel Film Scanner: Blackmagic Design at NAB 2014

  • Guntermann and Drunck at BVE 2014

    Guntermann and Drunck at BVE 2014

  • Philip Bloom on Tour in Belfast

    Philip Bloom on Tour in Belfast

  • Cinegy on BroadcastShow LIVE at IBC 2013

    Cinegy on BroadcastShow LIVE at IBC 2013

  • Blackmagic Design on BroadcastShow LIVE at IBC 2013

    Blackmagic Design on BroadcastShow LIVE at IBC 2013

  • Miranda on BroadcastShow LIVE at IBC 2013

    Miranda on BroadcastShow LIVE at IBC 2013

  • Harmonics Tom Lattie on BroadcastShow LIVE at IBC 2013

    Harmonics Tom Lattie on BroadcastShow LIVE at IBC 2013

  • JVC GY-HM600 series camera updates at IBC 2013

    JVC GY-HM600 series camera updates at IBC 2013

  • ATEME at IBC 2013

    ATEME at IBC 2013

  • Multidyne SilverBack, BullDog and Spider at IBC 2013

    Multidyne SilverBack, BullDog and Spider at IBC 2013

  • Cinegy at IBC 2013

    Cinegy at IBC 2013

  • Facilis at IBC 2013

    Facilis at IBC 2013

  • Blackmagic Design with the new ATEM Production Suite at IBC 2013

    Blackmagic Design with the new ATEM Production Suite at IBC 2013

  • MultiDyne: SilverBACK at NAB 2013

    MultiDyne: SilverBACK at NAB 2013

  • Quantel Pablo Rio at NAB 2013

    Quantel Pablo Rio at NAB 2013

  • Blackmagic Design: Products at NAB 2013

    Blackmagic Design: Products at NAB 2013

  • Facilis at NAB 2013

    Facilis at NAB 2013

  • AJA at BVE 2013

    AJA at BVE 2013

  • JVC at BVE 2012

    JVC at BVE 2012

  • Sony HXR-MC88 palm-sized camcorder shown plus UWP series wireless transmission at NAB 2019

    Sony HXR-MC88 palm-sized camcorder shown plus UWP series wireless transmission at NAB 2019

  • Teradek RT wireless CTRL.3 camera control shown at NAB 2019

    Teradek RT wireless CTRL.3 camera control shown at NAB 2019

  • Wireless Transmitters for Boxx TV at NAB 2018

    Wireless Transmitters for Boxx TV at NAB 2018

  • Pliant Technologies CrewComm Wireless Intercom at IBC 2017

    Pliant Technologies CrewComm Wireless Intercom at IBC 2017

  • Boxx TV Wireless Transmission with Meridian, Atom and Zenith on show at IBC 2017

    Boxx TV Wireless Transmission with Meridian, Atom and Zenith on show at IBC 2017

  • Videosys Wireless Transmitters at BVE 2014

    Videosys Wireless Transmitters at BVE 2014

  • Sony Wireless Microphones at BVE 2014

    Sony Wireless Microphones at BVE 2014

  • Cobham: Mini RF Transmitters at NAB 2013

    Cobham: Mini RF Transmitters at NAB 2013

  • Cobham: RF Transmitter at NAB 2013

    Cobham: RF Transmitter at NAB 2013

  • Pliant Technologies at IBC 2016

    Pliant Technologies at IBC 2016

  • Clear-Com LinQ at IBC 2014

    Clear-Com LinQ at IBC 2014

  • Cobham new receiver at IBC 2014

    Cobham new receiver at IBC 2014

  • Trilogy on BroadcastShow LIVE at IBC 2013

    Trilogy on BroadcastShow LIVE at IBC 2013

  • Cobham on BroadcastShow LIVE at IBC 2013

    Cobham on BroadcastShow LIVE at IBC 2013

  • Anton Bauer at NAB 2013

    Anton Bauer at NAB 2013

  • Anton Bauer at NAB 2012

    Anton Bauer at NAB 2012

  • SmallHD shows the Cine 7 monitor with camera control and integrated Teradek Bolt at NAB 2019

    SmallHD shows the Cine 7 monitor with camera control and integrated Teradek Bolt at NAB 2019

  • Vislink Technologies at NAB 2019

    Vislink Technologies at NAB 2019

  • Boxx TV Company Overview at NAB 2018

    Boxx TV Company Overview at NAB 2018

  • Boxx TV updates at NAB 2017

    Boxx TV updates at NAB 2017

  • Atom Lite from Boxx at NAB 2017

    Atom Lite from Boxx at NAB 2017

  • Quantum C80 from Cineo at NAB 2017

    Quantum C80 from Cineo at NAB 2017

  • Clear-Com FreeSpeak II at NAB 2016

    Clear-Com FreeSpeak II at NAB 2016

  • Thomson Broadcast at IBC 2014

    Thomson Broadcast at IBC 2014

  • Clear-Com FreeSpeak II at IBC 2014

    Clear-Com FreeSpeak II at IBC 2014

  • SIS LIVE ManPak and LoStow at IBC 2014

    SIS LIVE ManPak and LoStow at IBC 2014

  • Cobham satellite EXPLORER products at IBC 2014

    Cobham satellite EXPLORER products at IBC 2014

  • Dejero at NAB 2014

    Dejero at NAB 2014

  • Tally Technologies at BVE 2014

    Tally Technologies at BVE 2014

  • Gearhouse Broadcast on Tour May 2013

    Gearhouse Broadcast on Tour May 2013

  • Clear-Com: Tempest at NAB 2013

    Clear-Com: Tempest at NAB 2013

  • VideoSys at BVE North 2012

    VideoSys at BVE North 2012

  • IMT Broadcast at NAB 2012

    IMT Broadcast at NAB 2012

  • IDX at BVE North 2011

    IDX at BVE North 2011

  • RTS Telex at IBC2011

    RTS Telex at IBC2011

  • Telecast at IBC2011

    Telecast at IBC2011

  • Telestream Vantage Powerful, Scalable, Software-Enabled Media Processing Platform at BVE 2019

    Telestream Vantage Powerful, Scalable, Software-Enabled Media Processing Platform at BVE 2019

  • TestTree RF-Catcher at IBC 2018

    TestTree RF-Catcher at IBC 2018

  • Zixi announce their user interface control ZEN Master at NAB 2018

    Zixi announce their user interface control ZEN Master at NAB 2018

  • CueScript EMC prompter and control surface at IBC 2014

    CueScript EMC prompter and control surface at IBC 2014

  • Steffan does the Surf Forecast

    Steffan does the Surf Forecast

  • Glensound at IBC 2016

    Glensound at IBC 2016

  • Studer Glacier at IBC 2016

    Studer Glacier at IBC 2016

  • Dalet at NAB 2016

    Dalet at NAB 2016

  • Clear-Com at IBC 2015

    Clear-Com at IBC 2015

  • Dalet at IBC 2015

    Dalet at IBC 2015

  • Dalet at IBC 2014

    Dalet at IBC 2014

  • Glensound Dante at IBC 2014

    Glensound Dante at IBC 2014

  • IMT at NAB 2014

    IMT at NAB 2014

  • Glensound Cub at BVE 2014

    Glensound Cub at BVE 2014

  • Nucomm on BroadcastShow LIVE at IBC 2013

    Nucomm on BroadcastShow LIVE at IBC 2013

  • Cobham transmitters at IBC 2013

    Cobham transmitters at IBC 2013

  • Jampro Antennas at NAB 2013

    Jampro Antennas at NAB 2013

  • 4HM at BVE North 2011

    4HM at BVE North 2011

  • DekTec at IBC2011

    DekTec at IBC2011


Related Shows
  • Philip Bloom chats 4k: BVE Day 2

    Philip Bloom chats 4k: BVE Day 2


Articles
NAB Intelligence
Bruce Devlin - new It's that time of year again. 06:30 on road bikes on the Las Vegas Strip with a merry bunch of folks who believe they look good in lycra. As we pedal West up the hill towards Red Rock there will be stories of the year just gone and questions about what to look for at the show. I, for one, will be attending the Devoncroft event to check up on who is spending what and where. I will then look forward to the topics that might be buzzing around the halls. I predict there will be many displays of Machine Learning hiding under the banner of Artificial Intelligence. Some of these will show better picture quality, others will show personalisation engines, some will be improved search tools and yet more will be synthesising pictures and motions to replace reality with and Artificial reality that's more compelling for the viewer.
Tags: iss136 | nab | class | ai | smpte | st2110 | imf | Bruce Devlin - new
Contributing Author Bruce Devlin - new Click to read or download PDF
Keeping Your Post Prodction on Track with Subclips and Search Bins
Alex Macleod

For my 2nd Kit Plus article I thought I’d try and build on the theme of my first, and that’s one of making sure things are organised at all levels of your post production projects.

Last time I talked about trying as best as you can to stick to the ‘two week rule’, making sure that the names & locations of every asset you import, and every bin & sequence that you create in your project - will make sense to you regardless of how long it is you spend away from it.

Tags: iss136 | mediacity training | subclip | premiere pro | gvs | bve | bve2019 | Alex Macleod
Contributing Author Alex Macleod Click to read or download PDF
Remote Teams and Talent
Megan Cater If your studio works with non-local creative talent, you already know that there are opportunities and challenges associated with distributed production and post production. Bridging the distance not only allows you to find the best talent for the job anywhere in the world, it creates the potential for a diverse and globally-minded workforce that boosts the creativity and vision of your entire company.
Tags: iss136 | signiant | file acceleration | ftp | dropbox | sharepoint | slack | saas | media shuttle | Megan Cater
Contributing Author Megan Cater Click to read or download PDF
Looking for the Silver Lining
Harry Grinling According to the World Meteorological Organisation, there are 10 different types of cloud, each of which can be divided further into sub-types. They range from the cirrus, the thin floaty clouds which generally serve only to make the sky look beautiful to the towering, all-embracing cumulonimbus which can deliver fearful quantities of rain – the biggest cumulonimbus clouds can contain 50 million tonnes of water.
Tags: iss136 | cloud | lto | archive | storage | Harry Grinling
Contributing Author Harry Grinling Click to read or download PDF
Rotolight Anova Pro 2 User Review
Andy McKenzie The Anova PRO 2 is the fourth generation of Rotolight’s studio/location light, offering 70% more power output than its predecessor. It is claimed be one of the brightest LED lights ever launched in its class, delivering 10,700 lux at 3 feet yet consuming only 72 watts. Figure 1 shows the front with accessory mounting spigots (1), optional barn doors (2) and a gel frame holder.
Tags: iss136 | rotolight | anova pro 2 | led | lighting | flash light | dmx control | Andy McKenzie
Contributing Author Andy McKenzie Click to read or download PDF