Avid and the Future of AI: Faster Media Creation

Avid recently posted their first article in an exclusive Avid series on artificial intelligence (AI) and new technologies. Avid is tapping into the power of these emerging technologies to innovate and support their customers.

What is Avid doing in the field of artificial intelligence (AI)? That is the most frequently posed question by media businesses throughout the world.

They're certainly accomplishing a lot. AI has been present in our goods in various forms for almost ten years, and they even have a research center dedicated to maximizing emerging technology. Indeed, the findings of three of their AI-related research projects were published in the April 2023 issue of the Society of Motion Picture and Television Engineers' SMPTE Motion Imaging Journal. More on this later.

Avid spoke with two Avid media tech experts: Shailendra Mathur, Vice President of Architecture and Technology, and Rob Gonsalves, Engineering Fellow and AI enthusiast, to understand how AI will continue to affect media creation, what Avid is doing about it, and what it means for our industry.

Q. What are Avid customers asking about the use of AI in media production?
A. AI is a hot topic among Avid customers in all areas of the media industry. There’s tremendous interest in the potential applications of AI and machine learning (ML) within media content production. They're excited about the novel creative possibilities AI and ML could introduce and how these technologies can streamline workflows and enhance efficiency by automating time-consuming tasks. For example, AI can be used for metadata enrichment and deduplication, when you have a lot of duplicated content.

Q. Does AI have the intelligence and ability to replace humans in the workplace?
A. There is concern that AI might take away jobs, but we believe that as a transformative technology it will change how jobs are done. We prefer to focus on areas of AI where it acts as a creative assistant to help you be more efficient. From coming up with ideas for movies to helping with production, AI can assist in every step of content creation. These advancements could foster the creation of new processes in media production.

Q. Avid has been involved in AI for 10 years already? How?
A. There is AI and there is ML. Avid was one of the first companies to incorporate forms of AI into our solutions including PhraseFind and ScriptSync. Avid has an AI-related partnership with Microsoft, having integrated Microsoft's Azure media indexer into our asset management solutions. This AI tool provides transcriptions and allows customers with extensive footage to automate the identification of elements like logos and people's faces. It can even determine the number of people in a shot or whether it's a day or night scene - tasks that would normally require tedious labor logging this information manually. Avid has exposed AI tools working with alliance partners such as x.news for AI-assisted social media research. This enables journalists and producers to perform more efficient topic-based research.

Over the past few years Avid has conducted research in the use of AI in video editing, media ingest, analytics, automated metadata enhancement, music production and composition, archives, and on location. Apart from feeding the results into our own product roadmaps, we also publish and share results with the media industry.

A new AI development that Avid is utilizing is semantic speech search, a data searching technique. It understands the nuance of language, interpreting keywords and the intent and meaning behind a search query. Another example is OpenAI’s Whisper, which does a good job on speech-to-text transcription, including multilingual versions. It knows about 100 languages and the quality is great. Once you have good transcription, it opens up closed captioning, subtitling, and search. If you have good transcriptions, you can read, skim, find, and select what you need. Then you can go back and choose sound bites or conversations for your project. Transcriptions help with unscripted material with a lot of dialogue that needs condensing.

Q. Tell us how Avid goes about exploring the possibilities of using AI in production.
A. AI research has taken off like crazy. Things you couldn’t do a year ago you can do fast now. It’s an exciting time because things are moving quickly, and systems are improving.

Avid explores the use of AI in production by focusing on key areas. The first one is understanding what customers want, which we accomplish through continuous dialogue with them. Our machines can do lots of different things, but our customers might not need or want that, or they may want things that machines can’t yet do. We stay updated on the latest research to understand what new AI technologies and ML systems can offer and how our customers’ needs can be effectively addressed. Avid targets these opportunities for exploration and development. We have engagement with a variety of customers through the Avid Community Association (ACA) as well as individual conversations. Over the past few months, with ChatGPT and OpenAI making generative AI tools accessible to everyone, suddenly customer conversations have exploded. Apart from feeding some of the input into product roadmaps, we also take on the investigations outside of the product groups into something we call the RADLab.

Q. Where do you see AI going in the future?
A. AI is expected to grow exponentially and have a transformative impact on media production. AI could someday suggest relevant clips or segments based on its analysis of a project's context, acting like an assistant to the human creator working with large volumes of footage or audio files. AI also could become increasingly involved in video and audio processing, like color correction, reformatting, and similar audio tasks. It may support pre-production processes by providing an idea of what a scene or project might look like, helping to shape creative direction.

Read the full article from Avid HERE