How machine learning might affect media


Bruce Devlin - new TV-Bay Magazine
Read ezine online
Download PDF
Download PDF

Why has AI suddenly becoming interesting?

I have a curious relationship with technology. I’ve been doing it all my life and I see topics come and go over the years. This is the 3rd time around that I’ve seen Artificial Intelligence become trendy and this time, I think it will stick. There are 4 things that are different this time around and they are (in alphabetical order) Amazon, IBM, Google, Microsoft. All of those companies have had AI research programs running for years, but the big change now is that there is enough ubiquitous compute resource in the form of the cloud to make it commercially viable to build products around the platforms.

How does AI actually work? Firstly, I’m going to stop using the term AI which is a catch-all phrase that implies some sort of sentience to the computer. All experts agree that we’re a long way from that. Instead, I’m going to use the term Machine Learning (ML) which more accurately reflects where we are. Typically, an ML engine consists of some software that is able to extract information from a large data set and then correlate that data against a set of known outcomes. An example from years ago is a large data set of camouflaged tanks in forests from which information such as edges, contrast, and geometric pattern were correlated against the simple outcome tank or no tank. The computation required was immense and the standard methodology of using 80% of your data to train the model and 20% of the data to test the model was used.

Training in this context is basically the adjusting of the parameters of the model until the ML engine gets the right result for all of the training data. Once you’ve done this you can remember the parameters and see if it works for the test data. In the tank example, the results on the test data were pretty good and it seemed like the system worked. In real life, however, the system was virtually useless. Later scrutiny discovered that in the training data, all of the photos of tanks were on cloudy days and all the photos of no tanks were on sunny days. In effect the system had been trained to detect that the sun was shining.

Why you should be sceptical of ML

Given this scenario, you may dismiss this as a case of old technology and badly understood training methodologies. Unfortunately, we still have this problem today. If you’re not white Caucasian, then you might wonder why facial recognition software doesn’t work for you as well as it does for your white Caucasian friends. If you’re applying for a job in a big organisation, then you should be rightly worried about the training sets used to identify the perfect resume.

Why you should be optimistic about ML

So, in 2018 we still suffer from the issue of not really knowing what we have trained the ML engine to do, but we do know that there are certain applications that continue to get better and will have an impact on our life as media professionals.

Voice command and synthesis. I believe will radically change the way in which we interact with media equipment. In live TV we train humans and give them instructions by voice. It’s will not be long until software applications join that merry gang.

Auto translation and voice synthesis. This gets better every day and is good enough for many applications. If you haven’t played with Amazon’s Polly, then go here and click: https://aws.amazon.com/polly/ . Bruce’s Shorts will soon become Polly aware. I look forward to the responses from my international followers!

Image, pattern and emotion recognition. As a tennis fan, I have to say that the highlights shots being selected by IBM’s Watson for https://wimbledon.com are pretty amazing. I know that there is additional human curation, but the speed and accuracy empower the humans to create packages that would otherwise not get made because there is not enough time. Just remember that every time you search for an image on google, there is an ML algorithm curating content for you.

Will the machines take over?

AI and ML will dramatically change the way we do our media jobs. In that same way that the synthesiser did not replace live musicians, I don’t think that machines will replace humans in the media world. I think that the real creatives who understand the technology will make amazing content to keep my aging brain happy. Visit https://google.github.io/creatism/ and https://jukedeck.com/ to see if you agree.

Ciao

Bruce


Tags: iss132 | class | machine learning | ml | watson | ibm | Bruce Devlin - new
Contributing Author Bruce Devlin - new

Read this article in the tv-bay digital magazine
Download PDF
Article Copyright tv-bay limited. All trademarks recognised.
Reproduction of the content strictly prohibited without written consent.

Related Interviews
  • Classic tubes reinvented by Kino Flo at IBC 2018

    Classic tubes reinvented by Kino Flo at IBC 2018

  • Winner of the LP54 Miller Classic

    Winner of the LP54 Miller Classic

  • Global Distribution with mLogic at IBC 2013

    Global Distribution with mLogic at IBC 2013

  • Hamlet at IBC2011

    Hamlet at IBC2011

  • Bebob V-Mount Batteries at NAB 2019

    Bebob V-Mount Batteries at NAB 2019

  • Yospace: Advert Insertion at NAB 2013

    Yospace: Advert Insertion at NAB 2013


Articles
The University of the Third Age
Bernard Newnham Here's a cliché - "We all get to be old one day - if we're lucky". There comes a point when things like "....mastered in Dolby Vision Domestic and SDR Rec 709....." become just a touch unimportant (and actually I never really understood that stuff in the first place). I retired for the third time last year - BBC producer, and before that cameraman, then freelance producer, trainer, do-your-own camera, sound, editor, blah blah, then 11 years university teaching. I did my bit - never a BAFTA, but certainly the first into a good few things - but it all has to come to an end sometime.
Tags: iss139 | u3a | panasonic | davinci resolve | Bernard Newnham
Contributing Author Bernard Newnham Click to read or download PDF
To Remotely Go - TVFutures
Michael Parsons One of my biggest concerns as an academic responsible for the education of hundreds of students is the ‘appropriateness’ of much of the technology we purchase and implement within the curriculum. The last few years have seen tremendous change in all sorts of technologies, and the broadcast industry is just one sector that has seen some significant leaps in innovation.
Tags: iss139 | university | portsmouth | graduation | guildhall | newtek | streaming | pxw-fs7 | ndi | ip | ndihx ptz camera | Michael Parsons
Contributing Author Michael Parsons Click to read or download PDF
Keeping the Show on the Road
Andy McKenzie There is long-established saying in the media business that, if something goes wrong, at least nobody dies. It is almost true unless you happen to be a TV producer suffering a cardiac arrest because your primary video feed has gone blank during a high-budget programme.
Tags: iss139 | service | support | finepoint | maintenance | Andy McKenzie
Contributing Author Andy McKenzie Click to read or download PDF
IP Technology for Broadcast Audio Routing Systems
Tom Knowles As the AoIP debate continues to confuse and delight in equal measure, what is clear is different scenarios require specific solutions. So is there a solution that encompasses open standards and existing proven AoIP technologies to the benefit of all?
Tags: iss139 | aoip | ssl | solid state logic | system T | dante | audinate | aes67 | st2110 | domain manager | Tom Knowles
Contributing Author Tom Knowles Click to read or download PDF
The Future of Broadcast Connectivity
Jamie Adkin The use of KVM equipment has been essential to meet the evolving needs of the broadcast industry for many years. Over that time, many in the industry have recognised the importance of using IP-enabled KVM to break down technological barriers and enable real-time access to visuals wherever and whenever they’re needed. These components are vital parts in live production environments in particular.
Tags: iss139 | adder | kvm | ip kvm | Jamie Adkin
Contributing Author Jamie Adkin Click to read or download PDF