How to use VAE to improve eyes and faces - Stable Diffusion Art

Honyee Chua

Hatched by Honyee Chua

Mar 19, 2024

4 min read


How to use VAE to improve eyes and faces - Stable Diffusion Art


In the world of artificial intelligence and image processing, the concept of VAE, which stands for Variational Autoencoder, has gained significant attention. VAE is a part of neural network models that encode and decode images from a smaller latent space, resulting in faster computations. With Stable Diffusion, you can run VAE without installing any VAE files. Whether you are using v1, v2, or a custom model, it already has a default VAE included. When people talk about downloading and using VAE, they refer to using its improved version. The model trainer uses additional data to further fine-tune the VAE part of the model, rather than releasing an entirely new model as a large file. The improved VAE allows for better image decoding from the latent space, leading to enhanced details. It proves to be beneficial in rendering eyes and facial features where every fine detail matters. Stability AI has released two fine-tuned VAE decoder variants, EMA and MSE, to enhance the decoding process.

AI Drawing Basics:

In a Youtube tutorial titled "AI繪畫基礎教程," the concept of creating visually appealing prompts for AI drawing is explored. The tutorial explains the step-by-step alternating rendering syntax [A:B:X], which can be used to generate impressive and engaging prompts. By leveraging this technique, even beginners can enhance their AI drawing skills and progress towards becoming experts. The tutorial, titled "AI繪圖從小白到大神|stable diffusion AI繪圖軟件保姆級教學," serves as a comprehensive guide for individuals interested in exploring the world of AI drawing.

Connecting the Dots:

While VAE and AI drawing tutorials may appear to be unrelated topics at first glance, they share a common thread - the utilization of Stable Diffusion Art. Stable Diffusion Art, powered by VAE, allows for the generation of high-quality images by encoding and decoding them from a latent space. This aspect of VAE proves to be especially useful in rendering intricate details in eyes and faces, making them visually appealing. By incorporating the step-by-step alternating rendering syntax [A:B:X], individuals can create captivating prompts that fuel the AI drawing process. The combination of VAE and AI drawing techniques can lead to remarkable results.

Actionable Advice:

Now that we have explored the concepts of VAE and AI drawing, let's delve into three actionable pieces of advice to enhance your skills in both domains:

  • 1. Experiment with Different VAE Variants: As mentioned earlier, Stability AI has released two fine-tuned VAE decoder variants, EMA and MSE. To leverage the full potential of VAE, try using both variants and observe the differences in image decoding. This experimentation will help you understand the strengths and weaknesses of each variant and enable you to make informed decisions while rendering eyes and faces.
  • 2. Explore Unique Prompts: While the step-by-step alternating rendering syntax [A:B:X] is a powerful tool, it's essential to think outside the box and come up with unique prompts. Instead of relying solely on pre-defined prompts, try combining different elements or concepts to create prompts that are visually appealing and thought-provoking. This creativity will add a personal touch to your AI drawings and make them stand out.
  • 3. Continuously Learn and Improve: Both VAE and AI drawing are vast fields with endless possibilities. To truly excel in these domains, it's crucial to have a growth mindset and embrace continuous learning. Stay updated with the latest advancements in VAE techniques and explore new AI drawing tutorials and techniques. By consistently improving your knowledge and skills, you can push the boundaries of what is possible with VAE and AI drawing.


In conclusion, the integration of VAE and Stable Diffusion Art has revolutionized the way we approach image processing and AI drawing. The ability to encode and decode images from a smaller latent space has significantly enhanced the rendering of eyes and faces, capturing intricate details. By incorporating the step-by-step alternating rendering syntax [A:B:X], individuals can create visually stunning and engaging prompts for AI drawing. To excel in both VAE and AI drawing, it is essential to experiment with different VAE variants, explore unique prompts, and continuously learn and improve. With these actionable pieces of advice, you can unlock the full potential of VAE and create mesmerizing AI drawings. So, let your creativity soar and explore the limitless possibilities of VAE and AI drawing.

Hatch New Ideas with Glasp AI 🐣

Glasp AI allows you to hatch new ideas based on your curated content. Let's curate and create with Glasp AI :)