Redefining the archive with Raj Patel


Raj Patel TV-Bay Magazine
Read ezine online
by Raj Patel
Issue 80 - August 2013
The entire broadcast workflow has changed dramatically in recent years. Predictably, its been a slow-process. The enormity of transitioning from an analogue to a digital workflow is huge for a variety of reasons - planning, testing, implementation and budget, can mean some installations taking up to two years to complete. There are instances where a new digital infrastructure is in place but the facility continues to use tried and tested analogue workflows, somehow unaware of the potential thats now available to them. Almost as if there is a fear of embracing change or lack of understanding as to how they can fully utilise the system to create new workflows.

However, as broadcasters and content facilities make this transition, opportunities do arise for new ways of working, ways that take time to evolve. One of the biggest evolutions happening at the moment in the industry is in the role of the archive. For many years a last thought for broadcasters, the archive is often envisaged as the dusty, musty element at the end of the broadcast chain where material ends up once all the bells and whistles have been added and its been aired. Archived material sits there quietly in the background until someone needs to use it again after which its put back on the shelf. Until recently, like many other elements of the broadcast chain the archive was a fairly closed system: data was written to the media archive in a proprietary format, which meant there was no interoperability between systems from different vendors. Additionally, archive libraries could generally only be controlled by archive management systems.
Not any more. With the successful take-up of LTFS, broadcasters and content owners have true interoperability between what were once disparate systems. Now material can be acquired directly to disk and then dragged and dropped to data tape and transported back to the facility. This removes the need to re-ingest content to the archive and also enables large amounts of data to be transported and archived on a single LTO tape. This type of workflow is just as valid on location as it is in a production facility. To banish the end of the line archive message, once the tape has been loaded into the archive, duplicate copies can be made automatically to back-up the valuable material. The archive system can also automatically copy the content to a disk portion of the archive so that craft editors can start working with the material as swiftly as possible.

This places the archive much further forward in the production process alongside the ingest element of the chain. Instead of ingesting in the traditional sense, the material can now be moved directly into the LTFS archive. We can see how the archive begins to shake off the dusty tag, to create a more cool way of working.

So how did we get to this point? How did the archive leap from the back to the front of the broadcast chain and how does the MAM system know whats been ingested into the archive?
LTO has grown to become one of, if not the de-facto tape format installed in tape libraries by broadcast-centric organisations implementing tape (and disk)-based archives. What has to be kept in mind is that LTFS is not a file format or even a wrapper. Its a way of writing data to standard, off-the-shelf IT storage media. It presents an open standard for broadcasters to provide real interoperability between systems. Any tape written according to the LTFS specification can be read by any other system using the same specification.

As for the MAM system knowing whats arrived, intelligent archives can quickly read the index information from an LTFS-formatted tape (that may, for example, have been used on location to capture material directly from HD camera or intermediate disks) and directly assign UIDs to the content, populate the archive database and generate a low-resolution proxy (used for editing). Using a simple subscription setup, a Notification Service then announces the arrival of the new material to the controlling MAM system and pushes relevant data to the MAM describing the archived material based on rules selected by the broadcaster.

With all this in mind perhaps an archive really is no longer just an archive but what name should we give it? Answers on a tweet please @SGLFlashNet.


Tags: iss080 | sgl | product manager | redefining the archive | archive system | files | protection | data | workflow | Raj Patel
Contributing Author Raj Patel

Read this article in the tv-bay digital magazine
Article Copyright tv-bay limited. All trademarks recognised.
Reproduction of the content strictly prohibited without written consent.

Related Interviews
  • SGL at NAB 2012

    SGL at NAB 2012

  • SGL Broadcast at IBC 2015

    SGL Broadcast at IBC 2015

  • SGL at NAB 2015

    SGL at NAB 2015

  • SGL at NAB 2014

    SGL at NAB 2014

  • SGL at NAB 2013

    SGL at NAB 2013

  • Object Based Storage Solutions from Object Matrix at NAB 2017

    Object Based Storage Solutions from Object Matrix at NAB 2017

  • TMD talk workflow on BroadcastShow LIVE at IBC 2013

    TMD talk workflow on BroadcastShow LIVE at IBC 2013

  • Viaccess-Orca at IBC 2016

    Viaccess-Orca at IBC 2016

  • Sennheiser HDM Pro at BVE 2014

    Sennheiser HDM Pro at BVE 2014

  • Petrol at NAB 2012

    Petrol at NAB 2012

  • Petrol at IBC2011

    Petrol at IBC2011

  • Atomos with the Datacolor Spyder on BroadcastShow LIVE at IBC 2013

    Atomos with the Datacolor Spyder on BroadcastShow LIVE at IBC 2013

  • Datacolor Spyder on the Atomos stand at IBC 2013

    Datacolor Spyder on the Atomos stand at IBC 2013

  • Datavideo on the Holdan stand at BVE 2013

    Datavideo on the Holdan stand at BVE 2013

  • Datavision at BVE 2012

    Datavision at BVE 2012

  • Datavideo at IBC2011

    Datavideo at IBC2011

  • Telestream Vantage support for DPP at IBC 2014

    Telestream Vantage support for DPP at IBC 2014

  • Prime Focus Technologies at IBC 2016

    Prime Focus Technologies at IBC 2016

  • EBS at IBC 2015

    EBS at IBC 2015

  • EBS at IBC 2014

    EBS at IBC 2014

  • Clear-Com ProGrid at NAB 2014

    Clear-Com ProGrid at NAB 2014

  • Clear-Com HelixNet Partyline at NAB 2014

    Clear-Com HelixNet Partyline at NAB 2014

  • Atomos with the Samurai Blade on BroadcastShow LIVE at IBC 2013

    Atomos with the Samurai Blade on BroadcastShow LIVE at IBC 2013

  • Primestream on BroadcastShow LIVE at IBC 2013

    Primestream on BroadcastShow LIVE at IBC 2013

  • Object Matrix at BVE 2013

    Object Matrix at BVE 2013

  • Root6 at BVE 2012

    Root6 at BVE 2012

  • MOG Technologies at BVE 2012

    MOG Technologies at BVE 2012

  • Holdan and Teradek at BVE North 2011

    Holdan and Teradek at BVE North 2011

  • Cooke at IBC2011

    Cooke at IBC2011

  • Sensio at IBC2011

    Sensio at IBC2011

  • Radiant Grid at IBC2011

    Radiant Grid at IBC2011

  • ChyronHego show their PRIME Workflow at IBC 2018

    ChyronHego show their PRIME Workflow at IBC 2018

  • All IP Workflow from Quantum with Xcellis Workflow Storage solutions at NAB 2018

    All IP Workflow from Quantum with Xcellis Workflow Storage solutions at NAB 2018

  • Object Matrix Hybrid Workflow and Artifical Intelligence at NAB 2018

    Object Matrix Hybrid Workflow and Artifical Intelligence at NAB 2018

  • Workflow Solutions from Pronology at NAB 2017

    Workflow Solutions from Pronology at NAB 2017

  • Snell Advanced Media (SAM) 4k workflow at IBC 2015

    Snell Advanced Media (SAM) 4k workflow at IBC 2015

  • LIVEU Workflow solutions at NAB 2015

    LIVEU Workflow solutions at NAB 2015

  • Quantels Stream-based Workflows at IBC 2013

    Quantels Stream-based Workflows at IBC 2013

  • Streaming Media with Interra Systems at NAB 2017

    Streaming Media with Interra Systems at NAB 2017

  • New CEO and news update from TMD at NAB 2017

    New CEO and news update from TMD at NAB 2017

  • Tiger Technology at BVE 2015

    Tiger Technology at BVE 2015

  • ERA - Adobe Anywhere - at BVE 2015

    ERA - Adobe Anywhere - at BVE 2015

  • NETIA at BVE 2015

    NETIA at BVE 2015

  • Dalet at IBC 2014

    Dalet at IBC 2014

  • Pronology at IBC 2014

    Pronology at IBC 2014

  • Quantel LiveTouch at IBC 2014

    Quantel LiveTouch at IBC 2014

  • Quantel deal with AFP at IBC 2014

    Quantel deal with AFP at IBC 2014

  • Snell Kahuna Production Switcher at IBC 2014

    Snell Kahuna Production Switcher at IBC 2014

  • Telestream Wirecast and Switch at IBC 2014

    Telestream Wirecast and Switch at IBC 2014

  • Broadstream Solutions at NAB 2014

    Broadstream Solutions at NAB 2014

  • Telestream Enterprise at NAB 2014

    Telestream Enterprise at NAB 2014

  • Telestream Switch at NAB 2014

    Telestream Switch at NAB 2014

  • Dalet at NAB 2014

    Dalet at NAB 2014

  • ERA at BVE 2014

    ERA at BVE 2014

  • ERA Avere at BVE 2014

    ERA Avere at BVE 2014

  • Pixel Power on BroadcastShow LIVE at IBC 2013

    Pixel Power on BroadcastShow LIVE at IBC 2013

  • Atomos talking 4K on BroadcastShow LIVE at IBC 2013

    Atomos talking 4K on BroadcastShow LIVE at IBC 2013

  • Metus on BroadcastShow LIVE at IBC 2013

    Metus on BroadcastShow LIVE at IBC 2013

  • Volicon on BroadcastShow LIVE at IBC 2013

    Volicon on BroadcastShow LIVE at IBC 2013

  • Broadstream Solutions on the Oasys stand at IBC 2013

    Broadstream Solutions on the Oasys stand at IBC 2013

  • Oasys Chameleon at IBC 2013

    Oasys Chameleon at IBC 2013

  • Loft London Solutions with Cubix on the Oasys stand at IBC 2013

    Loft London Solutions with Cubix on the Oasys stand at IBC 2013

  • Tony Taylor from TMD talks about LTFS at IBC 2013

    Tony Taylor from TMD talks about LTFS at IBC 2013

  • Tony Taylor from TMD talks about Mediaflex CI

    Tony Taylor from TMD talks about Mediaflex CI

  • Tony Taylor from TMD talks about Post Production

    Tony Taylor from TMD talks about Post Production

  • Facilis at IBC 2013

    Facilis at IBC 2013

  • Telestream with Wirecast version five at IBC 2013

    Telestream with Wirecast version five at IBC 2013

  • Telestream with Post Producer at IBC 2013

    Telestream with Post Producer at IBC 2013

  • Yospace: Advert Insertion at NAB 2013

    Yospace: Advert Insertion at NAB 2013

  • Vimond Control Center at NAB 2013

    Vimond Control Center at NAB 2013

  • Telestream Vantage v5 at NAB 2013

    Telestream Vantage v5 at NAB 2013

  • TMD at NAB 2013: MediaFlex Reporting Module

    TMD at NAB 2013: MediaFlex Reporting Module

  • TMD at NAB 2013: MediaFlex Systems

    TMD at NAB 2013: MediaFlex Systems

  • TMD at NAB 2013: Content Intelligence

    TMD at NAB 2013: Content Intelligence

  • Telestream at BVE 2013

    Telestream at BVE 2013

  • Guntermann and Drunck GmbH at BVE 2013

    Guntermann and Drunck GmbH at BVE 2013

  • Tedial at NAB 2012

    Tedial at NAB 2012

  • Marquis Broadcast at NAB 2012

    Marquis Broadcast at NAB 2012

  • Root6 at NAB 2012

    Root6 at NAB 2012

  • Editshare at NAB 2012

    Editshare at NAB 2012

  • TMD at NAB 2012

    TMD at NAB 2012

  • PlayBox Technology at BVE 2012

    PlayBox Technology at BVE 2012

  • Suitcase TV at IBC2011

    Suitcase TV at IBC2011

  • Net Insight at IBC2011

    Net Insight at IBC2011

  • Tedial at IBC2011

    Tedial at IBC2011

  • IPV at IBC2011

    IPV at IBC2011

  • TSL at IBC2011

    TSL at IBC2011


Related Shows
  • Bubble and Squeak: Live and Loud from Monday at IBC 2013

    Bubble and Squeak: Live and Loud from Monday at IBC 2013


Articles
NAB 2019 Highlights
Paul MacKenzie The NAB Show in Las Vegas never loses its capacity to surprise. With NHK already transmitting in 8K and the Tokyo Olympics just a year away, this might have been the year that 8K equipment prices descended from the stratosphere to just plain expensive. The main trends at NAB 2019 were an increasing focus on HD-HDR, Media-over-IP and 4K. 8K was pretty low key except for a very promising demo on the Sharp stand: an extremely compact 8K camera at an impressively low price point: $4,000. Shooting at 30 frames per second to an internal card and using a prosumer-style Olympus lens, it looked very much an entry-level product but one with phenomenal potential for any videographer looking to work with very large display screen sizes.
Tags: iss137 | finepoint | nhk | media-over-ip | canon xa50 | xa55 | huddlecam | jvc | gy-hc550 | panasonic aw-ue-150 ptz | samsung | 8k signage | hdr10+ | livetrakl-20 | mediakind | Paul MacKenzie
Contributing Author Paul MacKenzie Click to read or download PDF
Lighting with Gurdip Mahal
Ian Muir Gurdip Mahal’s credits for lighting design are impressive. Including major Awards shows such as BBC Sports Personality of the Year, Children in Need, as well as The Voice, Top Gear and Crystal Maze, his CV would almost certainly include at least one show with which any one of us is familiar. In addition, he has applied his own particular style to performances by major artists such as U2, Beyonce and Lady Gaga.
Tags: iss137 | ac entertainment | gurdip mahal | lighting | stage lights | light assistant | Ian Muir
Contributing Author Ian Muir Click to read or download PDF
What is the JT-NM Tested Program
Bruce Devlin - new The National Association of Broadcasters (NAB) Show 2019 has come and gone with the usual onslaught of product announcements, launch parties, demonstrations and the usual high-density crowds preventing any high-speed movement between halls. The IP showcase, this year, featured a JT-NM tested program. If you're unfamiliar with the JT-NM, then it's worth checking out their website jt-nm.org where you can find out about the work being done to coordinate the different aspects of building an inter-working ST 2110 eco-system. The JT-NM tested program catalogue can be downloaded from the website and it highlights a series of tests that were performed prior to NAB on various products to see how they performed against the written standards upon which the ST 2110 eco system is based.
Tags: iss137 | st2110 | class | jt-nm | nab | ieee | secuirty | amwa | Bruce Devlin - new
Contributing Author Bruce Devlin - new Click to read or download PDF
State of the Nation - If Winter Comes
Dick Hobbs - new Here’s an important fact that might get lost in all the noise of the moment. HBO’s Game of Thrones, which is relentlessly covered in the press as well as being talked about by its fans, is not actually terribly popular. The opener of the current (and last, thank goodness) series attracted a consolidated audience of about 3.5 million – that includes 2.7 million who watched the first showing at 2am, plus those who watched it at a more civilised hour, or who recorded it. Informed comment seems to be that those who watch on catch-up at some time in the following week or so might add a million more.
Tags: iss137 | gof | games of thrones | 8k | hdr | Dick Hobbs - new
Contributing Author Dick Hobbs - new Click to read or download PDF
The Latest Trend in Cloud Ingest Portals
Megan Cater The unique demands of the media industry have created an equally unique ecosystem. With high-resolution video constantly moving over the Internet during production, post production, and multi-device, multi-channel distribution, as well as the need for flexible storage and security at every stage — all under impossibly tight timelines — there isn’t another industry like it. It’s not surprising then that technologies that work for some industries often don’t work the same in media, and cloud ingest is a great example.
Tags: iss137 | signiant | saas | ftp | dropbox | file transfer | media shuttle | Megan Cater
Contributing Author Megan Cater Click to read or download PDF