Re:Show HN: Generate Stable Diffusion scenes around 3D models
by tinytera on Thursday October 19, 2023 @06:08PM
(#37949420)
Looks pretty cool. Can anyone comment on how to hack together the opposite? That is, going from 2D object image to 3D rendering with in-painted background? Or is that not possible right now.
[ Parent
| on HN ]
Re:Show HN: Generate Stable Diffusion scenes around 3D models
by quitit on Thursday October 19, 2023 @06:33PM
(#37949698)
Do you mean transforming a sketch to a 3D-looking image(i.e not a 3d mesh model): If so Stable diffusion with control net can do that using a good prompt and the SDXL model.
Do you mean you have an existing photo of something and would like to add a realistic setting. There's a lot of ways to do this, but probably the easiest right now is the Generative Fill feature in Adobe Photoshop (beta).
Re:Show HN: Generate Stable Diffusion scenes around 3D models
by pj_mukh on Thursday October 19, 2023 @06:19PM
(#37949542)
2D to 3D networks are pretty amazing right now.
High poly meshes and low poly textures are possible.
Re:Show HN: Generate Stable Diffusion scenes around 3D models
by yanma on Thursday October 19, 2023 @08:48PM
(#37950842)
Not sure if they are planning on releasing this but you can mix a image2Nerf model (threestudio is a good repo for this) for the object 3d model, and an image2depth model like ZoeDepth to generate 3d background.