Eye to eye: How secure is your content?

Before getting up steam for this article, I contacted a former colleague who worked for several decades on the editorial side of the consumer-audio press. He became one of the first collectors of Compact Discs, a medium trusted by many archivists. The oldest items in his collection date back to the original Q4 1982 launch of audio CDs. Were the oldest discs still playable? “Yes,” he replied, “but, if you are writing on the subject, be sure to mention filiform corrosion which was a problem in the very early years."
Filiform corrosion, less elegantly known in this context as ‘CD rot’, turned out to be a phenomenon familiar to many motorists: rust. It occurs under a damaged or discontinuous protective film, especially lacquer or quick-dry paint. Early CDs, it appears, were prone to moisture ingress at the inner and outer edges. Since a CD is essentially a sandwich of transparent polycarbonate, reflective-metal, lacquer and printed label, the potential for oxidisation existed for several years until manufacturers took the trouble to seal the edges.
My own commercially-recorded audio CDs date back to 1995 and are all still perfectly playable. The only degradation noticed has been of the thin plastic foam included in multi-CD sets to prevent adjacent discs scuffing each other; the foam disintegrates. Most TV-Bay readers will have had the occasional bad experience with locally burnt CDRs and DVDs but those effects are usually noticeable as soon as the copy is checked.
The Dutch facilities company Nederlands Omroepproduktie Bedrijf went into archiving legend in the early 1980s when a zealous librarian decided to write ‘NOB’ on the label of every CD in its archive to discourage unauthorised removal. Unfortunately the ink in the pen employed reacted with both the CD lacquer and the metallic data surface, rendering every disc unplayable. This unlikely-sounding story was later confirmed to me by one of NOB’s senior managers.
Optical data storage on CD and DVD are today commonplace wherever data is archived. The weakness both of CDs and DVDs is their susceptibility to scratching, not from the ‘read’ side where you might expect it but from the label side. The optical beam reading a CD or DVD is always focused through the polycarbonate to the active data layer. Isolated scratches on the transparent surface of the disc therefore cause little harm to the transfer of optical data. Multiple scratches within a small area, also multiple dropouts within a close region of the metallic data carrier, are more likely cause a problem.
Many independent video and audio content producers today put their faith in an older and simpler technology than optical discs: rigid magnetic disc drives, casually termed 'hard drives'. The stand-alone variety are cheap, robust and can be shelf-stored as easily as tapes, ideally together with their power brick. Most drives come with a three-year guarantee covering the motor, the ultra-fragile write/read head and the supporting electronics. Buyers get to choose between a fairly tough USB in/out connector or a very fragile-looking miniature equivalent, with the newly emerging option of a Thunderbolt connector which, in terms of robustness, looks half way between the two.
A three-year media guarantee may be respectable in the fast-developing computer world but it is very short for an archivist. And how secure are the magnetic impulses? Some of the oldest magnetic recordings known are the reversals in Earth’s polarity captured over millions of years at gradually widening splits in the planet's crust, for example the mid-Atlantic. The magnetic domains involved are very large. Those used for data storage are sub-microscopic so inherently more likely to fade even if captured in a very high-remanence carrier.
Most broadcasters, along with an increasing number of production houses, today ingest as much as possible of their creative content to networked magnetic disc drives which can be accessed from any connected computer. This arrangement eliminates the wear and tear otherwise imposed on discrete media such as video tapes and reduces the danger of loss during delivery. Networked drives also allow any item to be delivered to, or browsed from, several locations at the same time.
Supporting the networked disc drives is commonly a library of magnetic tape cassettes or cartridges with a robotic loading mechanism to move the tapes from shelf to tape deck and back again. Since its introduction in 2000, the popular Linear Tape Open cartridge has evolved from 100 gigabyte-native LTO-1 to 1.5 terabyte-native LTO-5. Plans already exist for high-capacity LTO-6, LTO-7 and LTO-8. Future archivists will need very flexible technology to cope with this inheritance, let alone a legacy of 2 inch, 1 inch, three-quarter-inch, half-inch and quarter-inch video tapes, some of which may still be just about readable if the appropriate machinery can be found (or, more likely, 3D-printed).
The dangerous reality of modern broadcast archiving is that anything stored magnetically, and that obviously includes LTO, is susceptible to magnetic fade. Even if the supporting medium survives intact, the micro-magnetic waveform is subject to gradual randomisation. Analogue audio and video recordings gradually lose their energy, particularly at short wavelengths, though rarely tumble over the ‘digital cliff’ of becoming unplayable. About 1990, I bought a Yamaha SY77 music synthesizer and began inflicting malodorous melodies on anyone who came within listening distance. The SY77 captured MIDI tracks and voice-configurations to 3.5 inch diskettes of the kind used on contemporary personal computers. A few years on, I archived the resultant audio tracks as WAV files on CD. Just as well. The original diskette files gradually faded and became almost entirely unplayable.
Magnetically-recorded data can obviously be safeguarded by recopying at regular intervals. Unlike analogue copying which causes an inevitable loss of quality, each digital pulse is reconstructed to effectively ‘as new’ condition. The same applies to robotic-library tapes but here the additional question of media wear has to be considered. Thin tape is inherently fragile though accidents during lace-up are rare, particularly in linear (as distinct from helical scan) formats. Editing helical-scan video tape was never mechanically very kind to the tape surface but most video editing is now performed on disk with the write/read head separated from the magnetic medium by an air-gap so mechanical wear is almost a non-issue.
An archiving strategy already common among large-scale computer users involves the use of third-party data storage agencies. Many broadcasters have taken this a stage further by subcontracting their playout activity as well as their archiving to specialist service providers. Playout is a competitive market, including companies such as Advanced Broadcast Services, Arqiva, Ascent Media, Globecast, Playout247, Red Bee Media, Technicolor, Viasat and WRN Broadcast. Even the archives held by these organisations, however, should be regarded as supplementary to a programme producer’s or rights-holder’s archive rather than as a substitute for it.
Many broadcasters maintain some kind of disaster recovery centre to ensure continued operation in circumstances such as local flooding, technical outage or civil unrest. The accepted wisdom among archivists is that nothing is safe unless it is held at three or more separate locations.
Human factors are the most common cause of data loss, either through accidental file deletion or failure to anticipate future demand for content deemed not worth keeping. Data storage devices and services have become steadily more affordable with the passage of time and look set to continue on that path until such time as new memory technologies supercede existing technology.
Unless you are in politics, the safest archiving policy can be summed up by just two words: Delete nothing.

Tags: security | content | filiform | lto | iss058 | N/A
Contributing Author N/A

Read this article in the tv-bay digital magazine
Article Copyright tv-bay limited. All trademarks recognised.
Reproduction of the content strictly prohibited without written consent.

Related Interviews
  • Viaccess-Orca content security at IBC 2015

    Viaccess-Orca content security at IBC 2015

  • Viaccess-Orca at IBC 2016

    Viaccess-Orca at IBC 2016

  • Viaccess-Orca at IBC 2013

    Viaccess-Orca at IBC 2013

  • Global content distribution from Dejero at NAB 2019

    Global content distribution from Dejero at NAB 2019

  • Volicon discuss creating content and publishing for online and social platforms

    Volicon discuss creating content and publishing for online and social platforms

  • TMD at NAB 2013: Content Intelligence

    TMD at NAB 2013: Content Intelligence

  • Object Based Storage Solutions from Object Matrix at NAB 2017

    Object Based Storage Solutions from Object Matrix at NAB 2017

  • Prime Focus Technologies at IBC 2016

    Prime Focus Technologies at IBC 2016

  • Elemental Technologies at IBC 2015

    Elemental Technologies at IBC 2015

  • ROOT6 Technology at IBC 2015

    ROOT6 Technology at IBC 2015

  • Haivision on BroadcastShow LIVE at IBC 2013

    Haivision on BroadcastShow LIVE at IBC 2013

  • Front Porch Digital on BroadcastShow LIVE at IBC 2013

    Front Porch Digital on BroadcastShow LIVE at IBC 2013

  • Primestream on BroadcastShow LIVE at IBC 2013

    Primestream on BroadcastShow LIVE at IBC 2013

  • TMD talk asset management solutions on BroadcastShow LIVE at IBC 2013

    TMD talk asset management solutions on BroadcastShow LIVE at IBC 2013

  • Blue Lucy Media at IBC 2013

    Blue Lucy Media at IBC 2013

  • ChyronHego Paint at IBC 2013

    ChyronHego Paint at IBC 2013

  • Facilis at IBC 2013

    Facilis at IBC 2013

  • Facilis at NAB 2013

    Facilis at NAB 2013

  • TMD at NAB 2013: MediaFlex Reporting Module

    TMD at NAB 2013: MediaFlex Reporting Module

  • TMD at NAB 2013: MediaFlex Systems

    TMD at NAB 2013: MediaFlex Systems

  • Root6 at NAB 2012

    Root6 at NAB 2012

  • Prime Focus at IBC2011

    Prime Focus at IBC2011

  • SGL at NAB 2014

    SGL at NAB 2014

Related Shows
  • The KITPLUS Show discussing studios and kit

    The KITPLUS Show discussing studios and kit

Why MADI is Still Relevant
Stephen Brownsill While the original idea for MADI was to cater to a very narrow recording studio application, the standard remains a viable go-to multichannel audio technology. Beginning as a standard in 1991, MADI was first introduced to the world as digital production was beginning to come of age. MADI was put together in 1988 by Solid State Logic, AMS-Neve, Sony (DASH) and Mitsubishi (ProDigi) as a way to transport up to 56 channels of digital audio between large-format audio consoles of the day and digital multi-channel tape machines via 75-Ohm coaxial cables. Both tape-based machines have long since disappeared from the equipment landscape.
Tags: iss139 | madi | tsl products | aes10 | aes | dolby atmos | st-2110 | sam-q | Stephen Brownsill
Contributing Author Stephen Brownsill Click to read or download PDF
State of the Nation - Getting Connected
Dick Hobbs - new We are all familiar with statistics about the growth of the internet. Cisco’s latest report, for instance, says that global IP traffic is increasing at 26% a year, and will reach 4.8 zetabytes a year by 2022. The number of connected devices will be three times the world’s population by the same date.
Tags: iss139 | cisco | kth | clickclean | ibc | Dick Hobbs - new
Contributing Author Dick Hobbs - new Click to read or download PDF
REVIEW Canon UJ111x8_3B UHD Lens
Andy McKenzie Shooting in ultra high definition and high dynamic range has become the preferred option for all television productions with a potentially long commercial life. The hir-ing charge and indeed the outright purchase cost of cameras of this standard are not significantly greater than those of high definition standard dynamic range models. With half the world's news reporters now able to capture UHD video on their mobile phones, why give the production crews anything less?
Tags: iss139 | canon review | uj111x8 review | lens | zoom | digisuper | uj90x9b | hdtv | ccu | Andy McKenzie
Contributing Author Andy McKenzie Click to read or download PDF
The Making of Zero
Keith and David Lynch

The Brothers Lynch explain how they created the sinister atmospheric world for their new sci-fi short

In a post-apocalyptic world where humankind has emerged victorious in a war against artificial intelligent machines, a young girl dares to venture into the unknown. This is Zero, the new sci-fi short film from acclaimed British writer-director duo The Brothers Lynch which has premiered at the Tribeca Film Festival.

Tags: iss139 | blackmagic design | davinci resolve | editing | grading | grade | mk2 zeiss | superspeeds | cinema 4d | molinaire | Keith and David Lynch
Contributing Author Keith and David Lynch Click to read or download PDF
To Remotely Go - TVFutures
Michael Parsons One of my biggest concerns as an academic responsible for the education of hundreds of students is the ‘appropriateness’ of much of the technology we purchase and implement within the curriculum. The last few years have seen tremendous change in all sorts of technologies, and the broadcast industry is just one sector that has seen some significant leaps in innovation.
Tags: iss139 | university | portsmouth | graduation | guildhall | newtek | streaming | pxw-fs7 | ndi | ip | ndihx ptz camera | Michael Parsons
Contributing Author Michael Parsons Click to read or download PDF