Re:NeRF in the Wild: reconstructing 3D scenes from internet ...
by TaylorAlexander on Thursday August 06, 2020 @07:14PM
(#24076416)
Indeed. I am seeing some generative approaches that know what the object should look like in 3D and use that knowledge to imagine a model that matches a photo. I think such a technique would be useful for good approximation of plant models. Such a project would require some new datasets I would think, but seems like a good approach.
Just came across this which is neat: https://github.com/AljazBozic/DeepDeform
Also this might be useful: https://github.com/paschalidoud/hierarchical_primitives
For now Iām just beginning to collect data but I hope to contribute more to the field in time!
The method presented here wouldn't do well with your problem either. 3D reconstruction of moving objects is an unsolved problem!