MetaHuman - Real-Time Facial Model Animation Demo | State of Unreal 2023

TL;DR

MetaHuman Animator is a new technology that allows for high-quality character animation in a single machine, removing the need for specialized hardware and months of processing time.

Transcript

hi everyone our guiding vision for metahuman has been the democratization of complex character Technologies allowing you to work faster and see the results immediately a character is only truly believable if it's motion Fidelity matches its visual Fidelity but animating at this level is a hard task for even the most skilled Studios some of our best... Read More

Key Insights

• ✋ MetaHuman Animator democratizes complex character technologies by enabling high-quality character animations on a single machine.
• 🔂 The technology simplifies the animation process with a single-button click for processing and quick animation exporting.
• 😑 MetaHuman Animator utilizes video, depth data, and audio to capture facial expressions and produce convincing performance animations.
• ⌛ The technology reduces the time required for performance capture from months to less than a minute.
• 🛃 The custom epic facial solver and landmark detector enhance the fidelity and precision of the animations.
• 😑 MetaHuman Animator can generate facial rigs that predict all facial expressions from just three frames of video data.
• 😒 The technology is adaptable for use with various character styles, including realistic and stylized characters.

Questions & Answers

Q: What is the main aim of MetaHuman Animator?

MetaHuman Animator aims to democratize complex character technologies by allowing users to generate high-quality character animations on a single machine without the need for specialized hardware.

Q: How does MetaHuman Animator capture facial expressions?

MetaHuman Animator uses video and depth data to capture facial expressions and convert them into high-fidelity performance animations. It even utilizes audio to create convincing tongue animations.

Q: How long does it take to process a performance into animation?

For a performance of the demonstrated length, the processing time is less than a minute. MetaHuman Animator promises quick results, eliminating the months-long wait typically associated with performance capture.

Q: Can MetaHuman Animator be used with different types of characters?

Yes, MetaHuman Animator is compatible with various character styles, including realistic and stylized characters. It can be used on any rig that follows the new MetaHuman standard.

Summary & Key Takeaways

• MetaHuman Animator is a new capability of MetaHuman that democratizes complex character technologies, allowing for immediate results and high motion fidelity.

• The technology uses video and depth data to convert performances into high-fidelity animations, with the ability to incorporate facial expressions and audio.

• The animation process is simplified, with a single-button click to start processing and the ability to export animations quickly.