A Guide to Testing IPTV: Technologies and Challenges Part 5



Throughout this article series we have seen that IPTV network operators face many challenges and explained that effective test and measurement is key to overcoming these challenges. The majority of IPTV networks are still in the early stages of development and operators are therefore primarily concerned with optimising QoS parameters in order to get their IPTV systems working.

In this final article, we will look at some of the tools and technologies used to test IPTV systems, focusing on QoS monitoring (such as jitter, packet loss and network congestion) and cross layer measurements.

Test Tools and Technologies

Layer-specific Probes
Operators need to use different probe types for quality control at different layers. At the Formatting layer, digital waveform monitors (such as the WFM8300 or WFM7120) help operators detect many quality problems essentially checking adherence to broadcast and colorimetry standards. At the Distribution layer, operators need probes to detect quality problems in a wide variety of distribution and transmission channels. In IPTV systems this group includes probes for monitoring information sent through either telecommunication Core or Access networks (such as the IPM400A).

Basic confidence monitoring probes track a small set of key quality parameters. They act as an “indicator light,” telling the operator when something has gone wrong. While these basic probes can enhance an operators’ ability to react to a quality problem, they do not offer the information needed to proactively address system degradation before it becomes a quality problem. Extended confidence monitoring probes use more sophisticated analysis to make additional measurements of quality parameters. They act as “indicator gauges” telling the operator when something is going wrong.

Monitoring Jitter and Packet Loss Using Cross Layer IP-MPEG Tests
Earlier in this series we explained how MPEG encoding can be used to alleviate bandwidth limitations and avoid “bursty” video delivery. While encoding offers many benefits, it can render video streams more susceptible to dropped packets.

MPEG tests can be used to detect timing impairments at the Transport Stream layer and to detect lost or out of order packets using Continuity Counter tests. However, for a more complete solution, it is better to perform these in conjunction with IP tests, throughout the network. Cross layer testing can be employed in both the IP and MPEG domains, to trace and track performance degradation, so that action may be taken before the problem gets too serious.

Graphical plots, such as those in Figure 8, correlate events over time as they happen on one layer, and can show whether this has an effect on the other layer. This can help to isolate the root cause to a specific layer, allowing a fault to be traced and then corrective action taken. During fault situations, alarms, tracer files and fault logs can be time stamped allowing intermittent faults to be tracked to see if an MPEG stream had a Transport Stream layer fault, or if it was related to an IP event.

Cross-layer IP-MPEG testing (using IPM400A and MTS430) can also be used to flag network jitter and identify the source. Most MPEG streams contain a built-in timing packet (Programmable Clock Reference or PCR). Graphing of these parameters gives a good indicator of a stream suffering timing distortions due to packet bunching or network jitter. These measurements are so useful that some operators are re-establishing PCR feeds in MPEG-4 transports (which don’t strictly need PCR) as they take up little bandwidth and give fast indication of timing health.

As there are no standards for IP interval or jitter, these parameters are user defined and test equipment should allow user limits to be set to aid fault diagnosis.

Cross-layer testing can extend to RF layers, where off-air content is acquired for delivery over IP networks. Test probes at the RF layer can not only give indications of RF signal quality, but can also demodulate the signal and perform MPEG tests to detect any issues already present on the down link.

Measuring Packet Jitter/Delay, Packet Loss and Network Congestion Using MDI

Media Delivery Index is used to quantify two IP transport impairments, namely Packet Jitter or Delay and Packet Loss. These two test parameters are defined as Media Delay Factor (MDI-DF) and Media Loss Rate (MDI-MLR). Instruments such as IPM400A and MTS430 are used to measure MDI. MDI is expressed as a ratio:

“Delay Factor : Media Loss Rate”, e.g. “MDI = 150:14”

The Media Loss Rate is the number of packets lost during a period of 1 second; the example above shows a Delay Factor of 150 ms and 14 packets lost per second

The Delay Factor indicates how long a data stream must be buffered (i.e. delayed) at its nominal bit rate to prevent packet loss. It captures impairments on the IP layer, and will give you a general idea of network jitter.

However, there are two important points to note; firstly, MDI is not payload aware. That is, it cannot separate video traffic from other data and VoIP packets. Secondly, as we discussed earlier in the series, the raw UDP protocol does not provide any means to detect packet loss, so for raw UDP, the packet loss portion of MDI is not measured directly, it must be extrapolated using the MPEG Continuity Count error counts.

The MDI-DF can also give a measure of congestion in a network, by showing utilisation level, and detect if queuing is happening in network components, however it does not indicate how much of this is due to video packet bunching.

A good MDI does not mean a faultless IP transmission, and a bad MDI can be the result of non-IP related issues. A more complete solution is to use MDI in conjunction with MPEG layer protocol test, i.e. cross-layer measurements.

Quality Control for Stored File Based Content
Earlier in the series we mentioned that corruption of stored video on servers prior to playout can lead to the propagation of poor video through the system. It is difficult to detect these errors during transmission, and it is therefore better to prevent coding errors from being transmitted or correct them at source. Modern broadcast networks make extensive use of server technology for archive and playout purposes. There is a new breed of test tools that provide automated quality control capabilities for file based video, on the video file server before it is broadcast.

Conclusion

The long-term vision of IPTV service providers is to offer a system which can offer converged video, voice and data services over a single IP network. Comprehensive, cross-layer test and measurement systems, will play a vital role in the successful design and rollout of these IPTV networks.
Most IPTV providers are currently focusing on getting their networks working, but as full IPTV system deployment occurs the focus will shift towards 24/7 real time monitoring capability and service assurance. These monitoring solutions will be required to provide operators with wide visibility and information about their systems. As IPTV networks mature, the focus is also likely to shift from measurement of QoS parameters to monitoring and optimisation of control plane (QoE) parameters (such as IGMP and RTSP).

IPTV represents the convergence of the broadcast and telecommunications worlds and successful deployment will require tools and expertise from both worlds. Effective test and measurement will remain key to success throughout the IPTV technology lifecycle; a service provider may or may not know there is problem, but the subscriber will, and reputation, quality and business will suffer with persistent problems.

Tags: iss035 | iptv | probes | test and measurement | jitte | packet loss | ip-mpeg | file based content | N/A
Contributing Author N/A

Article Copyright tv-bay limited. All trademarks recognised.
Reproduction of the content strictly prohibited without written consent.

Related Interviews
  • VITEC EZTV Lite Platform for IPTV and digital Signage at ISE2020

    VITEC EZTV Lite Platform for IPTV and digital Signage at ISE2020

  • VITEC IPTV Digital Wall and Digital Signage Platform at ISE 2019

    VITEC IPTV Digital Wall and Digital Signage Platform at ISE 2019

  • VITEC EZ TV IPTV and Digital Signage Platform at NAB 2019

    VITEC EZ TV IPTV and Digital Signage Platform at NAB 2019

  • IPTV Digital Signage from VITEC at NAB 2017

    IPTV Digital Signage from VITEC at NAB 2017

  • Elemental Technologies news at IBC 2015

    Elemental Technologies news at IBC 2015

  • Thomson Video Networks at IBC 2014

    Thomson Video Networks at IBC 2014

  • BBright at IBC 2014

    BBright at IBC 2014

  • Viaccess-Orca at IBC 2014

    Viaccess-Orca at IBC 2014

  • Perception at NAB 2014

    Perception at NAB 2014

  • Elemental Technologies Software-Defined Video at NAB 2014

    Elemental Technologies Software-Defined Video at NAB 2014

  • Elemental Technologies HEVC solutions at NAB 2014

    Elemental Technologies HEVC solutions at NAB 2014

  • Elemental Technologies Multiscreen Solutions at NAB 2014

    Elemental Technologies Multiscreen Solutions at NAB 2014

  • Haivision on BroadcastShow LIVE at IBC 2013

    Haivision on BroadcastShow LIVE at IBC 2013

  • Albis Technologies celebrating ten years at IBC 2013

    Albis Technologies celebrating ten years at IBC 2013

  • Bridge Technologies QoE Monitoring with Mobile Videowall Display at IBC 2013

    Bridge Technologies QoE Monitoring with Mobile Videowall Display at IBC 2013

  • Visionary Solutions at NAB 2013

    Visionary Solutions at NAB 2013

  • Telestream Vantage v5 at NAB 2013

    Telestream Vantage v5 at NAB 2013

  • Visionary Solutions at NAB 2012

    Visionary Solutions at NAB 2012

  • Phabrix RX2000 at NAB 2013

    Phabrix RX2000 at NAB 2013

  • Phabrix at BVE 2012

    Phabrix at BVE 2012

  • Sencore at IBC2011

    Sencore at IBC2011

  • Leader at IBC2011

    Leader at IBC2011

  • Murraypro at IBC2011

    Murraypro at IBC2011

  • Hamlet at IBC2011

    Hamlet at IBC2011

  • Tektronix at IBC2011

    Tektronix at IBC2011

  • Phabrix at IBC2011

    Phabrix at IBC2011


Related Shows
  • Kiloview Video Converter Decoder Converter Live Streaming with Digi-Box

    Kiloview Video Converter Decoder Converter Live Streaming with Digi-Box


Articles
Cloud integration: The only way is up
Francois Vaillant

In 2017 we saw the introduction of SMPTE 2110 and since then, the transition to IP has emerged as a priority for broadcasters looking to streamline their operations, decrease their footprint and effectively integrate with an industry in a rapid state of flux. A 2020 survey by Devoncroft found that almost 20% of broadcasters had already deployed SMPTE 2110, and over 25% were planning to do so. Then came the pandemic, precipitating the need for on-the-fly collaboration and accelerating the transition to remote, virtual and cloud production.

Tags: dejero | smpte 2110 | dazzl | streaming | Francois Vaillant
Contributing Author Francois Vaillant Click to read
The Cloud - a measured approach
Ciaran Doran

With the buzz of ‘cloud’ everywhere in our industry it would be natural to think that cloud is the only game in town. Isn’t it time to step back and consider very carefully how, or whether, you make that journey to the cloud?

Tags: cloud | rohde and schwarz | rohde | schwarz | Ciaran Doran
Contributing Author Ciaran Doran Click to read
Meeting the specification
Chris Smeeton

A good technical specification will detail precisely what is required, from the equipment to the cables connecting it. Many specifications will give  particular manufacturers and model numbers. On many occasions, this makes tendering simple and gives vendors a secure and fair way to bid.

Tags: CPR specification | argosy cable | fire safe cable | eu standard cable | chris smeeton | Chris Smeeton
Contributing Author Chris Smeeton Click to read
Avid and Rohde & Schwarz
Ciaran Doran

Rohde & Schwarz is the perfect ingest partner to build flexible workflows with Avid.

Tags: Rohde and Schwarz | avid | spycernode | editing | asset management | venice | Ciaran Doran
Contributing Author Ciaran Doran Click to read
Sennheiser MKE 400 hands on review and test
KitPlus

Sennheiser have just released two products aimed at simplifying audio on the move, the MKE400 shotgun microphone and the XS Lav Mic, in this review we’re looking at the MKE400.

Tags: sennheiser mke400 | sennheiser mke 400 | sennheiser mke 400 quality | best microphones for youtube | mic for youtube videos | sennheiser mke 400 hands on | microphone review | iphone videography | microphones | sound for video | camera microphone | microphone for iphone | microphone for youtube | video microphone | shotgun mics | smartphone microphone | vlogging mic | best microphone for video | shotgun microphone review | mke 400 | sennheiser mke 400 hands on review | sennheiser mke 400 test | KitPlus
Contributing Author KitPlus Click to read