Stable Diffusion in Maya
Mandala (Tibetan: དཀྱིལ་འཁོར།) A traditional painting made from colored sand. Once complete, Mandalas are dismantled, reflecting the traditional Buddhist belief in the transitory nature of material life.
Ever wondered what Stable Diffusion would be like as a Maya renderer?
Spoiler alert: It's awesome. Mandala implements most of Stable Diffusion functionalities into Maya, without relying on external tools. Welcome to the future of rendering! Of course, this is just a first step. Here are some of the highlights:
Update: V1.1 Alpha
Can now render with an Alpha channel! Using Dichotomous Image Segmentation (DIS), or the RGBA pass' alpha when using ControlNet or Depth2Img.
Integration in Maya
Arnold Aovs are directly fed into Stable Diffusion. Canny edges, Hough lines, Sobel edges, and Openpose-style joints are also automatically rendered and used as input to condition Controlnet and Depth2img, in just a few clicks.
ControlNet
Use ControlNet to turn basic 3D models into awesome, fully lit, textured images in 3 clicks. No complex setup, no connection to make manually, and no external software to run!
Depth2Img
Like ControlNet, Depth2Img uses a depth pass to generate anything you want. It's amazing for concept art, making quick textures, experimental stuff, etc.
Texture Generator
Generate tileable, high-res texture maps with normal maps out of a simple prompt!
Camera Mapping
Mandala includes an advanced, layered camera mapping function that takes into account the camera occlusion and its frustum to create masks! This makes it super-easy to texture assets using AI.
Model Manager
Fully featured ML model manager. Add any model from the awesome HuggingFace.co or Civita.ai and try exciting new things on-the-fly!
Prompt Editor
Craft your prompts in an un-cluttered, no-nonsense UI, with spell checking, history & presets.
Render View Editor
A Maya-style render view allows you to save images and settings with ease - in my tests, it's actually faster than Maya's original Renderview!
Inpainting
The good old region renders now in-paints the image to make corrections.
Render Animations
Make cool experimental animations! Batch rendering doesn't work yet, but render animation does. It even saves all your settings along with the PNG files so you can re-use them later!