Re:NeRF in the Wild: reconstructing 3D scenes from internet ...
by Ut_Pwnsim on Thursday August 06, 2020 @04:55PM
(#24075372)
What is the precision required (or used in your datasets) for camera position and angles? Is the geotagging in the images from common cellphones and smart cameras enough? Were they back-calculated using some other method from non- or poorly-georeferenced images?
Re:NeRF in the Wild: reconstructing 3D scenes from internet ...
by duckworthd on Thursday August 06, 2020 @05:04PM
(#24075452)
It's hard for me to say how precise camera position and direction needs to be. We use COLMAP to estimate both via multi-view stereo.
The method is unattended, in the sense that it's photos + camera parameters in and scene representation out. The photos should all be of the same scene (e.g. the Trevi Fountain). Once you have a scene representation, you can ask what the scene would look like from new camera angles with your choice of lighting.
Choosing camera angles is straightforward. You tell me where and what direction the camera is facing. The question then becomes, how do you specify your choice of lighting? The answer is, you can't do so directly. Instead, you provide a picture with the lighting you want, and with a little magic, we can find a way to imitate that lighting. The way we do is by finding a corresponding "appearance embedding" via numerical optimization.