News for hackers. Stuff that matters.

A comment on NeRF in the Wild: reconstructing 3D scenes from internet photography. Parent comment

Re:NeRF in the Wild: reconstructing 3D scenes from internet ... by TaylorAlexander on Thursday August 06, 2020 @03:06PM (#24074328)
Great work! I’m an ex googler currently working on a farming robot we hope to make open source. I’m particularly interested in neural reconstruction of plants in a field. I want to capture the 3D structure of the plants as well as semantics like plant species. I’ve found that normal photogrammetry produces poor reconstructions due to movement of the plants in the wind.

We’re potentially about to start a non profit and formally kick off our whole robot as open source. I’m interested in finding research partners who would like to help produce a research paper on 3D reconstruction of plants. I can produce a high quality geo located dataset with 2cm accurate GPS tags, but I have no experience with neural rendering. This is work I want to do over the course of the next year.

Do you know anyone interested in helping with thank kind of work? Thanks!

[ Parent | on HN ]
Re:NeRF in the Wild: reconstructing 3D scenes from internet ... by duckworthd on Thursday August 06, 2020 @03:54PM (#24074781)
I'm a bit new to the field myself, so I'm afraid I can't provide any contacts. Ask me again in a couple of years.

The method presented here wouldn't do well with your problem either. 3D reconstruction of moving objects is an unsolved problem!

[ Parent | on HN ]
Re:NeRF in the Wild: reconstructing 3D scenes from internet ... by TaylorAlexander on Thursday August 06, 2020 @07:14PM (#24076416)
Indeed. I am seeing some generative approaches that know what the object should look like in 3D and use that knowledge to imagine a model that matches a photo. I think such a technique would be useful for good approximation of plant models. Such a project would require some new datasets I would think, but seems like a good approach.

Just came across this which is neat: https://github.com/AljazBozic/DeepDeform

Also this might be useful: https://github.com/paschalidoud/hierarchical_primitives

For now I’m just beginning to collect data but I hope to contribute more to the field in time!

[ Parent | on HN ]