Map Features in OpenStreetMap with Computer Vision

Re:Map Features in OpenStreetMap with Computer Vision by anakaine on Saturday March 22, 2025 @09:59PM (#43450351)

Id love to see a bit more detail on fine tuning SAM/2 to do things like detect pools or solar arrays. Both these are fantastic things to have mapped for community resilience projects, but I've not been able to follow along with SAM2 fine tuning at all.

I've got a Yolov8 model which does quite a good job of finding and segmenting out solar, but the edges are absolutely horrible and require an insane amount t of work to clean up. I've seen results from SAM2 that has been trained, and the results look massively better.

Wouldn't put these in OSM due to stereo6 comment about accuracy, but I could sure use them elsewhere.

[ Parent | on HN ]

Re:Map Features in OpenStreetMap with Computer Vision by daavoo on Monday March 24, 2025 @09:50AM (#43461072)

> but I've not been able to follow along with SAM2 fine tuning at all.

Hi there! There is no SAM2 finetuning involved in the project. The segmentation data from OSM doesn't have enough quality to properly train a segmentation model from it.

What I am using here is a YOLO model for bounding box prediction. The bounding boxes from OSM are good enough for this. I then pass the each individual bounding box as a "prompt" to SAM2 for a segmentation of what is inside.

I also tried to pass the centroid of the box as a "prompt" for SAM but it gave worse results.

[ Parent | on HN ]