News for hackers. Stuff that matters.
Re:Worldsheet: Wrapping the World in a 3D Sheet, View Synthe... by svantana on Monday January 04, 2021 @09:16AM (#25631573)
I think you're misunderstanding the paper. They are using multiple images in the learning phase to infer the 3d structure. At test time, it works on novel scenes with just a single image.
Re:Worldsheet: Wrapping the World in a 3D Sheet, View Synthe... by btown on Monday January 04, 2021 @01:06PM (#25635374)
I believe from a second reading this is correct - after training on the Matterport real estate image dataset, it appears they can transform novel images (which happen to be from that dataset, so they are still home interiors but can handle completely distinct scenes with distinct furniture etc.). Which is actually really fascinating and leverages decades of innovation. This is actually really cool and fully justifies the hype in the title.