Gaussian Material Synthesis (SIGGRAPH 2018)

TL;DR

A learning-based system enables the rapid synthesis of photorealistic materials by recommending new materials based on user preferences.

Transcript

Creating high-quality photorealistic materials for light transport simulations typically includes direct hands-on interaction with a principled shader. This means that the user has to tweak a large number of material properties by hand, and has to wait for a new image of it to be rendered after each interaction. This requires a fair bit expertise a... Read More

Key Insights

• 🧑‍🦽 Manual tweaking and rendering of photorealistic materials is a time-consuming and trial-and-error process.
• 🚄 The learning-based system can recommend new materials based on a few high-scoring samples, significantly speeding up the material synthesis workflow.
• 👻 A convolutional neural network predicts images of recommended materials in real-time, allowing for quick adjustments and exploration in a 2D latent space.
• 👾 The system combines latent space embedding and Gaussian Process Regression to provide intuitive visualization and guidance for users in fine-tuning materials.

Questions & Answers

Q: How does the learning-based system enhance the workflow of creating photorealistic materials?

The system recommends new materials to the user based on a small set of high-scoring samples, reducing the need for manual tweaking and rendering. This speeds up the process and allows for mass-scale material synthesis.

Q: What is the role of the convolutional neural network in this system?

The neural network predicts images of the recommended materials in real-time, providing instant visual feedback to the user. This enables quick adjustments and exploration in a 2D latent space without the need for domain expertise.

Q: How does the system help users in fine-tuning recommended materials?

The system embeds high-dimensional shader descriptors into a 2D latent space, where users can explore and adjust materials without domain expertise. Additionally, Gaussian Process Regression provides color coding to highlight regions of interest.

Q: Can the system handle variations and advanced effects in material synthesis?

Yes, the system can generate a broad range of new material models and easily incorporate displacements and other advanced effects. It offers flexibility to suit the artistic vision of users.

Summary & Key Takeaways

• Creating high-quality photorealistic materials for light transport simulations usually requires manual tweaking and rendering of each material, resulting in a lengthy trial-and-error process.

• The presented system uses a learning-based approach to recommend new materials to the user, based on a small set of high-scoring samples.

• A convolutional neural network predicts images of these materials in real-time, allowing for quick adjustments and exploration in a 2D latent space.