Re:Plan2Scene: Converting Floorplans to 3D Scenes
by madhawav on Saturday June 12, 2021 @05:09AM
(#27482956)
This is actually a very interesting video. Reflection effects look very realistic.
[ Parent
| on HN ]
Re:Plan2Scene: Converting Floorplans to 3D Scenes
by TaylorAlexander on Saturday June 12, 2021 @02:53PM
(#27486652)
Yah it’s cool stuff! Currently NERF takes a very long time to calculate and render but folks are working on improving that.
Re:Plan2Scene: Converting Floorplans to 3D Scenes
by madhawav on Saturday June 12, 2021 @04:17PM
(#27487165)
Do you think its possible to decouple lighting effects from the generated 3D scene? Currently it seem to simply copy the actual lighting condition in the environment. In a way, it's a limitation. It's much better if it can provide the RGB color + other material information (SVBRDF decomposition). If that's possible, then these meshes can be used in other environments.
Re:Plan2Scene: Converting Floorplans to 3D Scenes
by TaylorAlexander on Monday June 14, 2021 @03:46PM
(#27507362)
I think its definitely possible, though I don’t know if the algorithms exist now. You would probably need to capture the scene under different lighting conditions, and probably from different angles. But assuming there is some theoretical way to go from photos to a mathematical representation of material characteristics I’d think we’ll eventually have neural nets that can do the conversion.