To view this page ensure that Adobe Flash Player version 11.1.0 or greater is installed.
AUDIO Content Source Audio- Video Encoder A Audio- Video Encoder B Audio- Video Decoder A Audio- Video Decoder B Full Reference Test Set PEAQ Full reference testing helps ensure quality audio delivery Type B Type A Expected Results: Codecs Differentiate Themselves Per Tested Sequence And Bit Rate Increasing Mean Quality Rating Bit Rate Figure 1: Target Bit-Rate Designation by Adam Schadle, Vice President of Video Clarity W ith the ever-increasing amount and variety of programming, devices, screen sizes, quality levels, and delivery methods today, broadcasters and delivery networks must be able to measure the quality of audiovisual content — and their processes for delivering it — to ensure it will meet standards that satisfy audiences, subscribers, advertisers, and regulators. One of the most accurate methods for assessing changes in quality is full-reference testing, which compares original content to processed content. Full-reference testing produces very accurate and highly repeatable results at a much lower cost than subjective testing with human listeners. Astute content distributors recognize that fact and are using full-reference testing to help them determine the best combination of equipment and delivery schemes to use in their operations. In terms of selecting an appropriate delivery bit rate, the workflow is fairly straightforward (Figure 1): An A/V source player feeds an uncompressed signal to the encoder’s input. The compressed output of the encoder can be fed directly to the decoder’s input and captured in real time to form one element in a set of full-reference test sequences. Additional outputs are then captured and added to the sequence set by making small-step changes in the encoder bit rate. You can create more full-reference test sequence sets by using different source content and repeating the process of capturing and storing the decoder output sequences. (This workflow can also be performed as a file process in place of real-time play/record functions.) Once the full-reference comparisons are made for various bit rates, differences in audio quality caused by each bit-rate change can be measured in each sequence set using objective perceptual techniques such as PEAQ (Perceptual Evaluation of Audio Quality). The PEAQ model, an international standard for audio quality measurement, was calibrated to deliver scores that correlate with the mean opinion scores of a panel of expert listeners who took part in a formal subjective test. In this sense, PEAQ can be 64 | KITPLUS - THE TV-BAY MAGAZINE: ISSUE 101 MAY 2015 viewed as an “average expert listener” score. By plotting the scores for each set of sequences on a graph, it’s easy to see the quality trend for each bit rate under comparison. PEAQ is optimized to measure the perceptual quality of wideband (20 kHz) audio codecs and has been successfully used to measure the quality of other wideband audio devices such as analog-to-digital converters, digital- to-analog converters, and sample-rate converters. The mean quality rating is either scored as a 0 to -4 or 1 to 5. The score is an objective differential grade (ODG), which represents the overall severity of the impairments in the test signal. Its meaning is defined on the rating scales of Figure 2. This objective, full-reference test measurement will provide a quality value for the corresponding audio in each frame of video. These frame-by-frame quality values can be compared directly to the quality values from other elements 0 Imperceptible 5 Perceptible but Not Annoying -1 4 Slightly Annoying -2 3 Annoying -3 2 Very Annoying -4 PEAQ BS.1387 1 BS.1116 Figure 2: PEAQ Impairment Scales