Ed Ulbrich: How Benjamin Button got his face

TL;DR

This talk discusses the groundbreaking computer visualization techniques used to create a completely digital human head for the film "The Curious Case of Benjamin Button."

Transcript

I'm here today representing a team of artists and technologists and filmmakers that worked together on a remarkable film project for the last four years. And along the way they created a breakthrough in computer visualization. So I want to show you a clip of the film now. Hopefully it won't stutter. And if we did our jobs well, you won't know that ... Read More

Key Insights

• 🎥 The film "The Curious Case of Benjamin Button" features a completely computer-generated digital human head for the main character, Benjamin Button, played by Brad Pitt.
• 🔍 The project of creating a digital human head was deemed impossible in the early '90s, but advancements in technology and the determination of the director, David Fincher, made it possible.
• 💡 The visual effects team used a combination of technology from various industries, including medical imaging and video game development, to create a realistic and dynamic digital head.
• 🔬 Dr. Paul Ekman's Facial Action Coding System (FACS) provided the foundation for capturing the range of expressions and movements of Brad Pitt's face.
• 💻 The team utilized a process called "image analysis" to match the performance footage of Brad Pitt with the 3D database of aged Benjamin, resulting in a seamlessly integrated virtual head.
• 💡 Creating a believable virtual head required attention to lighting, eyes, mouth, and skin displacement, ensuring accurate and realistic details.
• ⚙️ The process of creating the digital head required a team of 155 people over two years, and it showcased the potential for advancements in animation and visual effects technology.
• 🎬 The achievement of creating a digital human head opens up possibilities for future films and projects, pushing the boundaries of what is considered possible in the visual effects industry.

Questions & Answers

Q: How did the team overcome the challenge of aging the main character backwards?

The team used a combination of facial markers, 3D scanning, and image analysis to create a comprehensive database of Brad Pitt's face at different age increments, allowing them to digitally age the character.

Q: What was the role of motion capture in the creation of the digital head?

The team initially explored marker-based motion capture techniques but realized it wouldn't capture the subtleties of the human face. Instead, they focused on capturing the skin's movements using a surface capture technology called 'Contour.'

Q: What was the significance of the Facial Action Coding System (FACS) in this project?

FACS, developed by Dr. Paul Ekman, provided a foundation for capturing the various poses and shapes of the human face. It allowed the team to create a 3D database of every possible expression that Brad Pitt's face could make.

Q: How did the team ensure that Brad Pitt's performance translated onto the digital Benjamin Button?

Brad Pitt watched the footage shot on location and improvised the scenes to match the performance. By using image analysis and code software, they were able to reconstruct a 3D head that precisely matched Brad Pitt's performance.

Q: What challenges did the team face in recreating the aging process realistically?

The team had to create a lighting system, eye system, mouth system, and accurate skin displacement to ensure Benjamin's appearance matched the other actors and portrayed the aging process convincingly.

Q: How many people and how long did it take to create the digital head for "The Curious Case of Benjamin Button"?

The project involved 155 people over two years and required extensive work in various areas, including hair styling and an all-digital haircut.

Q: What was the significance of creating a digital puppet that Brad Pitt could operate with his own face?

By creating a digital puppet that directly mirrored Brad Pitt's performance, the team eliminated the need for animators to interpret or enhance the behavior, resulting in a more authentic portrayal of Benjamin Button.

Summary & Key Takeaways

• "The Curious Case of Benjamin Button" film required a computer-generated head for the main character, Benjamin Button, in the first hour of the movie.

• Through a combination of facial markers, 3D scanning, and image analysis, the team was able to create a digital puppet that accurately portrayed Brad Pitt's performance.

• The process involved creating a lighting system, eye system, mouth system, and skin displacement to ensure believability.