News for hackers. Stuff that matters.
Re:Show HN: Generate Stable Diffusion scenes around 3D models by tinytera on Thursday October 19, 2023 @06:08PM (#37949420)
Looks pretty cool. Can anyone comment on how to hack together the opposite? That is, going from 2D object image to 3D rendering with in-painted background? Or is that not possible right now.
Re:Show HN: Generate Stable Diffusion scenes around 3D models by quitit on Thursday October 19, 2023 @06:33PM (#37949698)
Do you mean transforming a sketch to a 3D-looking image(i.e not a 3d mesh model): If so Stable diffusion with control net can do that using a good prompt and the SDXL model.

Do you mean you have an existing photo of something and would like to add a realistic setting. There's a lot of ways to do this, but probably the easiest right now is the Generative Fill feature in Adobe Photoshop (beta).

Re:Show HN: Generate Stable Diffusion scenes around 3D models by pj_mukh on Thursday October 19, 2023 @06:19PM (#37949542)
2D to 3D networks are pretty amazing right now.

High poly meshes and low poly textures are possible.

Re:Show HN: Generate Stable Diffusion scenes around 3D models by yanma on Thursday October 19, 2023 @08:48PM (#37950842)
Not sure if they are planning on releasing this but you can mix a image2Nerf model (threestudio is a good repo for this) for the object 3d model, and an image2depth model like ZoeDepth to generate 3d background.