Do you have that written up anywhere? That sounds amazing as I'd love to see mesh generation in Houdini.
* Generate depth image from 3D meshes
* Send depth image to local HTTP server running Hugging Face diffusers library. Generate textured image.
* Cast textured image to a 2D plane surface that covers the camera extends.
* Traverse the UV surface of the 3D meshes and find closest point on the 2D stable diffusion image plane. Copy the RGB value to UV texture and you’re done.