News for hackers. Stuff that matters.
Re:DreamFusion: Text-to-3D using 2D Diffusion by jonas21 on Thursday September 29, 2022 @04:49PM (#33026990)
Can someone explain what's going on in this example from the gallery? The prompt is "a humanoid robot using a rolling pin to roll out dough":

https://dreamfusion-cdn.ajayj.com/gallery_sept28/crf20/a_DSL...

But if you look closely, the pin looks like it's actually rolling across the dough as the camera orbits.

Re:DreamFusion: Text-to-3D using 2D Diffusion by WithinReason on Thursday September 29, 2022 @04:57PM (#33027114)
The rolling pin is above the table but the shading is wrong because they don't render shadows.
Re:DreamFusion: Text-to-3D using 2D Diffusion by ajayjain on Thursday September 29, 2022 @05:35PM (#33027539)
Hi! Ajay here. Correct, our shading model doesn't compute intersections, since that's a bit challenging with a NeRF scene representation.
Re:DreamFusion: Text-to-3D using 2D Diffusion by chaps on Thursday September 29, 2022 @06:15PM (#33028049)
Super interesting work. Do you think that's a solvable problem and something you'll work on?
Re:DreamFusion: Text-to-3D using 2D Diffusion by jnbrrn on Friday September 30, 2022 @12:19AM (#33030885)
I think what's happening here is that the flat-looking table is actually raised up in the center, in the shape of something like a smooth pyramid. There's dough painted on both sides of the rolling pin, but because of the curvature of the "table" you only see each side's dough when the camera is on that side of the pyramid.