Lights, Camera, Algorithm! Where AI Fits into Movies, Games and Creativity | TechCrunch Disrupt 2023

TL;DR

AI fits into movies, games, and creativity as a tool for accelerating production, lowering barriers, and empowering artists rather than simply replacing them. Wonder Dynamics applies AI to motion capture, lighting, and compositing, Runway supports generated imagery and experimentation, and Nvidia’s Kairos demonstrates generative speech for AI-powered NPCs. The discussion also confronts costs, ownership, consent, compensation, and responsible use. Read on for the panel’s practical examples and ethical priorities.

Transcript

we have ritika Kalia from Runway Ty Sheridan from Wonder Dynamics and John Spitzer from Nvidia please welcome them as well as our moderator Devin called away to the stage please let's give them a hand well well back again uh thank you very much for joining me um in lieu of asking you all to laboriously explain what it is your companies do although ... Read More

Key Insights

• 😯 AI tools, such as motion capture, generative speech, and upscaling, can revolutionize film production by speeding up processes, reducing costs, and making visual effects more accessible.
• 👻 The democratization of AI tools allows artists and storytellers to explore new ways of storytelling, experiment with different ideas, and reach a wider audience.
• ©️ Maintaining ethics and artist rights is crucial when using AI in film production to ensure fair compensation, consent, and responsible use of copyrighted material.

Questions & Answers

Q: Where does AI fit into movies, games, and creative work?

AI can accelerate demanding production tasks and give more people access to filmmaking and game-development tools. The panel presents it as a way to empower artists, expand storytelling, and experiment with new ideas while keeping creators involved in the process.

Q: What does Wonder Dynamics use AI to do?

Wonder Dynamics uses AI to address motion capture as well as lighting and compositing. Ty Sheridan says these processes traditionally require many artists, substantial time, and significant expense, so the company aims to make them faster and more accessible.

Q: How can AI make visual effects more accessible?

AI can reduce the time and money required for processes such as motion capture, lighting, and compositing. Wonder Dynamics hopes this will give storytellers access to effects that previously required the budgets available to only a limited group within the industry.

Q: What example does Ty Sheridan give of traditional motion capture work?

Sheridan says he worked on a movie called “Player One” in 2016 and spent six weeks in motion capture. He describes the technology used there as cumbersome, illustrating why some effects-heavy films may not get made.

Q: What is Nvidia Kairos?

Kairos is the name of Nvidia’s demonstration for AI-powered NPCs. The panel shows it as an example of generative speech being produced inside a game engine.

Q: How does Runway support artists and storytellers?

Runway provides AI tools that lower barriers to creative experimentation and storytelling. The material shown during the panel includes generated imagery, demonstrating one way artists can explore ideas with the technology.

Q: Are AI tools replacing human creators in film and games?

The panel rejects a simple equation between AI and job replacement, arguing that the issue depends on how the technology is used in each business. Sheridan says Wonder Dynamics focuses on using AI responsibly to empower artists and keep them involved in the creative process.

Q: What ethical concerns arise when AI is used in film production?

The discussion emphasizes artist rights, ownership, consent, fair compensation, and responsible use of copyrighted material. Its central ethical principle is that AI should support creators and preserve their role in the production process.

Summary & Key Takeaways

• Wonder Dynamics offers an AI solution for motion capture, lighting, and compositing, aiming to speed up and democratize the film production process.

• Runway provides AI tools that lower the barriers of entry for artists, allowing them to experiment and tell their stories more easily.

• Nvidia's AI-powered NPC technology enables game developers to create immersive and compelling content, making game creation more accessible.