News for hackers. Stuff that matters.
Re:Denser 3D Point Clouds in OpenSfM by jsch on Monday October 31, 2016 @04:25PM (#12840625)
COLMAP is an open source structure-from-motion and multi-view stereo software and is hopefully useful for people here as well: https://colmap.github.io/, http://people.inf.ethz.ch/jschoenb/colmap/
Re:Denser 3D Point Clouds in OpenSfM by deckar01 on Monday October 31, 2016 @10:06AM (#12836775)
I discovered VisualSfM this weekend after trying Adobe ReCap 360. The photo reconstruction functionality of ReCap is cloud based, which was a blocker for me, because I have a beefy graphics rig and want to script it into a pipeline.

I am curious how OpenSfM compares to VisualSfM and if they are related in any way.

Edit: The VisualSfM license is only open for non-commercial uses. OpenSfM is BSD licensed, so I can safely build my business on top of it.

Re:Denser 3D Point Clouds in OpenSfM by yubin on Monday October 31, 2016 @10:24AM (#12836929)
Both VisualSfM and OpenSfM use similar methodology (incremental structure from motion) to reconstruct 3D scene points and camera positions from photos.

And yes, you can build your own tools (even commercially) with OpenSfM.

Re:Denser 3D Point Clouds in OpenSfM by deckar01 on Monday October 31, 2016 @11:49AM (#12837874)
I am curious how the quality compares and if they have common library dependencies.
Re:Denser 3D Point Clouds in OpenSfM by yorwba on Monday October 31, 2016 @10:50AM (#12837211)
I am curious, did you try to build VisualSfM yourself? I had to use it for a project at Uni a few years ago and the build process was quite adventurous, without this[0] guide I would have been completely lost. Would be interesting to know whether it has gotten any easier.

[0] http://www.10flow.com/2012/08/15/building-visualsfm-on-ubunt...

Re:Denser 3D Point Clouds in OpenSfM by deckar01 on Monday October 31, 2016 @11:43AM (#12837799)
No, I used the windows binaries during evaluation.
Re:Denser 3D Point Clouds in OpenSfM by exthaicitizen on Wednesday November 02, 2016 @12:57AM (#12852359)
Adobe doesn't make ReCap 360, Autodesk does.
Re:Denser 3D Point Clouds in OpenSfM by efkv on Monday October 31, 2016 @10:29AM (#12836994)
For those who have not tried it, OpenSfM is an amazing tool. Can't wait to play with dense reconstructions. Congrats mapillary team, I know this has been a long time coming!
Re:Denser 3D Point Clouds in OpenSfM by yummybear on Monday October 31, 2016 @08:43AM (#12836181)
I wonder if you wouldn't get cleaner results if you eliminated points that don't have an adjacent point nearer than a certain distance?
Re:Denser 3D Point Clouds in OpenSfM by yubin on Monday October 31, 2016 @10:15AM (#12836844)
Yes. We can apply different heuristics to remove outlier points. One interesting way to do it will be to train a neural network to refine the dense point cloud.
Re:Denser 3D Point Clouds in OpenSfM by Pica_soO on Monday October 31, 2016 @08:41AM (#12836157)
Do they use the same NeuralNets that are used to improve videos on these pictures to reconstruct the details?
Re:Denser 3D Point Clouds in OpenSfM by data0815 on Monday October 31, 2016 @12:22PM (#12838262)
How well would this work in a situation with artificial (moving) lighting? I have seen reconstructions for wrecks underwater, and we are interested in doing something similar.
Re:Denser 3D Point Clouds in OpenSfM by rasmi on Monday October 31, 2016 @02:08PM (#12839366)
It is possible to correct for all sorts of different lighting conditions. See here: http://grail.cs.washington.edu/projects/timelapse/
Re:Denser 3D Point Clouds in OpenSfM by BHSPitMonkey on Monday October 31, 2016 @05:50PM (#12841265)
What techniques are available to transform point clouds like these into closed polygonal meshes (like the ones you see in Google Earth where 3D imagery is available)?
Re:Denser 3D Point Clouds in OpenSfM by MichailP on Monday October 31, 2016 @11:11AM (#12837442)
Is it possible to use images from say Google Street View to reconstruct 3D city model with this tool? Maybe it could fall into fair use for small part of city...
Re:Denser 3D Point Clouds in OpenSfM by maxerickson on Monday October 31, 2016 @11:18AM (#12837516)
It would likely violate their TOS.

No creation or augmentation of data sets based on Google’s Content or Services. You will not use Google’s Content or Services to create or augment your own mapping-related dataset (or that of a third party), including a mapping or navigation dataset, business listings database, mailing list, or telemarketing list.

There's probably some other issues.

https://developers.google.com/maps/terms

Re:Denser 3D Point Clouds in OpenSfM by rasmi on Monday October 31, 2016 @11:38AM (#12837736)
You would need a significant number of images for a particular scene (more than Google Street View would provide -- maybe in the tens or hundreds depending on the complexity -- but perhaps mining Google Maps photo uploads for a particular location would suffice). A Google Image search for a particular landmark is likely to yield better results ([1], [2], [3]). Also, stitching together multiple scenes after reconstructing each individual scene may prove difficult. Apple Maps does a sort of satellite view projection on to 3D building models ([4]), but this is far from a dense reconstruction.

[1]http://grail.cs.washington.edu/projects/timelapse/

[2]http://grail.cs.washington.edu/projects/timelapse3d/

[3]https://grail.cs.washington.edu/rome/

[4]http://www.theverge.com/2015/9/29/9413583/apple-maps-3d-flyo...

Re:Denser 3D Point Clouds in OpenSfM by toomuchtodo on Monday October 31, 2016 @12:33PM (#12838382)
You'll want to use the OpenStreetView dataset for that, which has a much more liberal license for collected images than Mapillary. (OSV is a direct competitor to Mapillary, with OSV being sponsored by Navteq)

http://openstreetview.com/terms/

You might also consider mining Flickr by geotag, constraining to CC licenses that allow for use.

Re:Denser 3D Point Clouds in OpenSfM by maxerickson on Monday October 31, 2016 @01:36PM (#12839002)
Or even just directly capture geotagged photos. That's going to be the best way to ensure good coverage of the target area.
Re:Denser 3D Point Clouds in OpenSfM by toomuchtodo on Monday October 31, 2016 @01:43PM (#12839082)
What would the capture source be if not an existing online repository?
Re:Denser 3D Point Clouds in OpenSfM by maxerickson on Monday October 31, 2016 @01:44PM (#12839096)
A camera.

That's where Mapillary and OSV get their imagery from, people that decide to go out and take pictures.

An additional advantage is that you then have full rights to the imagery (so for example, you can upload them to both services).

Re:Denser 3D Point Clouds in OpenSfM by toomuchtodo on Monday October 31, 2016 @02:45PM (#12839729)
That'd work of course! Bit more of a schlep to build out your processing pipeline to ingest those images, store them, and then render them with OpenSfM, but could definitely be done.
Re:Denser 3D Point Clouds in OpenSfM by maxerickson on Monday October 31, 2016 @06:56PM (#12841703)
Oh yeah, it'd be quite some work, especially if small isn't small. But I think at the moment, neither OpenStreetView nor Mapillary can be relied on for coverage, so the shortcut of using images gathered by others isn't widely available.
Re:Denser 3D Point Clouds in OpenSfM by ris on Monday October 31, 2016 @04:45PM (#12840771)
> OSV is a direct competitor to Mapillary, with OSV being sponsored by Navteq

s/Navteq/Telenav/

Re:Denser 3D Point Clouds in OpenSfM by toomuchtodo on Monday October 31, 2016 @04:59PM (#12840875)
I goofed. My apologies.
Re:Denser 3D Point Clouds in OpenSfM by MichailP on Monday October 31, 2016 @12:36PM (#12838424)
Thanks for the very informative and detailed answers. The Google TOS seems very restrictive, and I can't quite stomach the idea that our data, including photo of my house, is free to use by big companies in any way conceivable, but on the other hand, a small, maybe scientific purpose, is in violation of TOS :(
Re:Denser 3D Point Clouds in OpenSfM by abstractbeliefs on Monday October 31, 2016 @02:05PM (#12839327)
Photos of a house from the public street isn't your data though. This is why you are empowered to go and collect all sorts of data and information that is exposed to the public in all sorts of ways, and do with it as you please.

You have just as much right to take pictures of Google's complexes from public locations and bill them should they want to use what you have collected, and this whole situation is really a good thing. Things in the public domain are in the public domain.

Re:Denser 3D Point Clouds in OpenSfM by MichailP on Monday October 31, 2016 @02:57PM (#12839828)
You are right. But on some level I don't like that huge disbalance of power, where on one hand you can take a photo with your smartphone, but someone can take a fleet of vehicles and run them 24/7 around globe, photographing everything, making hi res lidar images, georeferencing, coupling that with smartphone data, etc. I would be more OK with it, if it was open dataset though. End of rant :)
Re:Denser 3D Point Clouds in OpenSfM by dharma1 on Monday October 31, 2016 @10:05AM (#12836767)
very cool. that's quite dense.

So the segmentation convnet is applied on the 2d image pixels before SfM, rather than on the point cloud data? I've been looking for neural net semantic segmentation for 3D point cloud data

Re:Denser 3D Point Clouds in OpenSfM by yubin on Monday October 31, 2016 @10:18AM (#12836876)
Exactly, the convnet is applied on 2d pixels instead of on 3D point clouds. If one have labelled 3D points (e.g. if a point is part of a car or not), one can train a network for recognition directly on 3D points.
Re:Denser 3D Point Clouds in OpenSfM by dharma1 on Monday October 31, 2016 @11:13AM (#12837456)
Nice. I wonder if this could be used for robot navigation. The segmented point clouds especially are useful.

Been looking forward to a DIY Roomba project using point clouds and neural nets for navigation

Re:Denser 3D Point Clouds in OpenSfM by eriknstr on Monday October 31, 2016 @09:24AM (#12836456)
Never heard of OpenSfM before but have been looking for something like it.
Re:Denser 3D Point Clouds in OpenSfM by spacemanmatt on Monday October 31, 2016 @03:09PM (#12839933)
I have personal and professional projects that involve mundane data feeding and service-building around this core capability. This totally fills a niche that's been on my tech radar for a while.
Re:Denser 3D Point Clouds in OpenSfM by zump on Monday October 31, 2016 @09:15PM (#12842571)
So why can't this be used instead of LIDAR for Self-Driving cars?

Experts?

Re:Denser 3D Point Clouds in OpenSfM by zubairq on Monday October 31, 2016 @08:50AM (#12836234)
Pretty amazing stuff!!
Re:Denser 3D Point Clouds in OpenSfM by washwash on Monday October 31, 2016 @09:21AM (#12836432)
great