News for hackers. Stuff that matters.
Re:Map Features in OpenStreetMap with Computer Vision by daavoo on Saturday March 22, 2025 @03:58PM (#43448195)
> But we still need human intervention to make sure the detected objects are drawn correctly.

Hi, I am the author.

The demo app and any provided code example includes a step asking a human to verify the detected features. You can't upload them automatically unless you modify the source code.

I reiterate the human verification across the docs, linked post, and any code samples.

I haven't ever uploaded features automatically. In fact I manually edited and labeled hundreds of swimming pool samples myself before even training the first version.

Happy to hear and implement any ideas on how to improve the process to prevent automated features to be uploaded.

I know some people might say: just don't publish the tool, I think we can do better at embracing AI and having an open discussion.

Re:Map Features in OpenStreetMap with Computer Vision by halosghost on Saturday March 22, 2025 @04:29PM (#43448399)
I am afraid your “human in the loop” isn't [0].

You acknowledge the problem of AI slop up-front, but seem to have chosen to plow forward anyway. Please do consider your actions and their effects carefully [1]. You are in a position of potential influence; try not to squander it.

All the best,

-HG

[0]: https://pluralistic.net/2024/10/30/a-neck-in-a-noose/

[1]: https://web.cs.ucdavis.edu/~rogaway/papers/radical.pdf

Re:Map Features in OpenStreetMap with Computer Vision by Vinnl on Saturday March 22, 2025 @04:35PM (#43448429)
"plow forward" and implying they didn't consider their actions and their effects seem ungenerous, given the list of precautions in the comment you're replying to.

You can disagree on whether the measures are effective, of course, but they're clearly not thoughtless.

Re:Map Features in OpenStreetMap with Computer Vision by benatkin on Saturday March 22, 2025 @06:09PM (#43449041)
It was the equivalent of vibe coding:

> The polygons the algorithm had drawn were consistently of poor quality with stray nodes and nodes far outside the pool boundaries, and the imports hadn't been discussed with local communities.

https://news.ycombinator.com/item?id=43448498

Re:Map Features in OpenStreetMap with Computer Vision by Vinnl on Sunday March 23, 2025 @02:41PM (#43454842)
That too seems an ungenerous characterisation, and the GP could not have deduced that from the OP. I'm glad the author is constructively incorporating criticism and working to turn this into a useful tool that OSM users will benefit from, because they wouldn't have been the first to get overly defensive after their work was interpreted in the worst light possible.
Re:Map Features in OpenStreetMap with Computer Vision by necovek on Saturday March 22, 2025 @05:12PM (#43448673)
I believe your critique would be more valuable if you've actually uncovered cases where the human in the loop missed these issues and bad or "wobbly" data ended up in the OSM database: did this happen? (the other comment from another person confirms it has)

Otherwise, you are discounting their effort based on a prejudice — others might be unable to supervise an AI, but someone who's actually developed it might have a better chance of success.

Re:Map Features in OpenStreetMap with Computer Vision by yorwba on Saturday March 22, 2025 @05:18PM (#43448715)
The screenshot in the article shows wobbly data. You may need to zoom in and look closely to notice.
Re:Map Features in OpenStreetMap with Computer Vision by hgomersall on Saturday March 22, 2025 @05:51PM (#43448924)
Tracing satellite data is really boring to do but easy to check. I would describe AI acting as a centaur here, or perhaps a pairing of equals.
Re:Map Features in OpenStreetMap with Computer Vision by yorwba on Saturday March 22, 2025 @05:12PM (#43448672)
> Happy to hear and implement any ideas on how to improve the process to prevent automated features to be uploaded.

Idea: do not automatically create features that a human can simply approve, instead require them to draw the polygon themselves.

Re:Map Features in OpenStreetMap with Computer Vision by K2h on Saturday March 22, 2025 @06:50PM (#43449306)
long time editor of osm here. what you describe is what the rapid [1] editor from meta does where user is forced to manually select objects overlayed sat imagery. is limited to 50 objects before user must push. a great method i think

[1] https://rapideditor.org/

Re:Map Features in OpenStreetMap with Computer Vision by daavoo on Saturday March 22, 2025 @05:29PM (#43448794)
That is what I will implement before bringing back the demo https://news.ycombinator.com/item?id=43448649
Re:Map Features in OpenStreetMap with Computer Vision by IshKebab on Saturday March 22, 2025 @05:22PM (#43448752)
That kind of defeats the point surely?
Re:Map Features in OpenStreetMap with Computer Vision by echoangle on Saturday March 22, 2025 @05:26PM (#43448769)
Well it can still detect features in the satellite image that are missing on the map. That would already be a large help, no?
Re:Map Features in OpenStreetMap with Computer Vision by timewizard on Saturday March 22, 2025 @09:36PM (#43450260)
The point of what? Slamming a bunch of contributions in? Or actually improving the product for end users?
Re:Map Features in OpenStreetMap with Computer Vision by IshKebab on Sunday March 23, 2025 @04:20PM (#43455594)
Adding missing features. I'm pretty sure if users are searching for swimming pools they'd rather have a swimming pool with slightly bent sides than none at all.
Re:Map Features in OpenStreetMap with Computer Vision by boredpudding on Saturday March 22, 2025 @05:21PM (#43448740)
I don't understand the 'human verification' aspect.

Your docs show a simple image where the user can choose to keep a new object or not. [0] Afterwards it says: "The ones you chose to keep will be uploaded to OpenStreetMap using upload_osm.". This is uploading features automatically. The fact that it asks 'are you sure' is just silly. We all know if humans have to click yes 90% of the time, and no 10% of the time, they'll miss a lot of no's.

The image also proofs that:

- You don't see any polygons properly. You just see a an image of where the pool is. Already on the image I can see that if the polygons align to that image, it will be a total mess.

- You don't see any polygons further away from the object.

Both these points are in stereo's reply that the resulted data was a mess.

Please consider pulling the project. This will generate a lot of data that volunteers will have to check and revert.

[0] https://github.com/mozilla-ai/osm-ai-helper/blob/main/docs/s...

Re:Map Features in OpenStreetMap with Computer Vision by daavoo on Saturday March 22, 2025 @05:26PM (#43448775)
> This will generate a lot of data that volunteers will have to check and revert.

This is just not true. The data can be easily identified with the `created_by` tag. And I have been reviewing myself any data uploaded with the demo (with a clear different criteria on what is good enough)

Re:Map Features in OpenStreetMap with Computer Vision by karlgkk on Saturday March 22, 2025 @09:04PM (#43450099)
adding a "created_by" tag is not opt in. it's opt out. you are de facto choosing how OSM volunteers must approach their work, without their consent.
Re:Map Features in OpenStreetMap with Computer Vision by AyyEye on Saturday March 22, 2025 @09:08PM (#43450130)
Can I suggest also adding a tag for ML originated features that's not specific to your demo/app? Maybe this can help put extra eyes on them and/or help prevent them from polluting the DB wholesale. Maybe client apps could have a toggle to allow/reject them.
Re:Map Features in OpenStreetMap with Computer Vision by xorcist on Sunday March 23, 2025 @08:39AM (#43452500)
If the upstream project thinks there may be a potential problem with this, that is a problem in itself. Try not to get defensive about it, just pull the project and have another go at the problem in collaboration with upstream. Perhaps parts of the project and be useful for upstream? Perhaps another workflow could make the project better?

We all strive for better open data. I upstream feel there is a risk that automated uploads could be easier with this project, creating more boring work for them which is already enough of a problem, that animosity will be a net negative for everyone in this space. Technical solutions such as new tags or opt out schemes will not solve the problem.

Re:Map Features in OpenStreetMap with Computer Vision by hartator on Sunday March 23, 2025 @11:43AM (#43453665)
Mozilla engineers think they are way better than the rest of us though. Don’t need to follow the same rules.
Re:Map Features in OpenStreetMap with Computer Vision by frozenseven on Sunday March 23, 2025 @04:53PM (#43455829)
The real "problem" here is that someone is once again upset about AI for no good reason. A good cue to consider making an AI-based competitor to OpenStreetMap.
Re:Map Features in OpenStreetMap with Computer Vision by tga_d on Sunday March 23, 2025 @06:00PM (#43456240)
The OSM community has had extremely clear rules around automated edits for most of its existence. Every experienced mapper has seen first-hand the sorts of problems they can cause. The fact that it's using AI in this instance does not give any sort of exception to these rules. To emphasize, there are already AI-assisted tools that are allowed,[0] this isn't a blanket application of "no AI ever," it's about doing so properly with the right community vetting.

[0] Most notably: https://wiki.openstreetmap.org/wiki/Rapid

Edit to add: To be clear, they have since taken steps to try to resolve the concerns in question, the discussion is ongoing. I suspect at the end of this we will get a useful tool, it's just off to a rocky start.

Re:Map Features in OpenStreetMap with Computer Vision by crooked-v on Sunday March 23, 2025 @05:03PM (#43455895)
The "good reason" is that OSM is supposed to contain real data, not wobbly AI guesswork data.
Re:Map Features in OpenStreetMap with Computer Vision by frozenseven on Sunday March 23, 2025 @05:15PM (#43455965)
Robust computer vision is not guesswork, and probably better than what the average contributor can do. The "wobbly" concerns were already addressed.
Re:Map Features in OpenStreetMap with Computer Vision by wiml on Sunday March 23, 2025 @05:47PM (#43456167)
That's not an assertion I'm going to take seriously without evidence.
Re:Map Features in OpenStreetMap with Computer Vision by frozenseven on Sunday March 23, 2025 @06:04PM (#43456258)
Preliminary evidence seems very good. The gatekeepers are already doing damage control.
Re:Map Features in OpenStreetMap with Computer Vision by wiml on Sunday March 23, 2025 @06:39PM (#43456478)
Link the evidence, then. Numbers, not vibes.
Re:Map Features in OpenStreetMap with Computer Vision by cratermoon on Saturday March 22, 2025 @10:52PM (#43450554)
https://zirk.us/@cratermoon/113796212085352331

Stop forcing AI into everything. Nobody asked for it. Everyone hates it.

Re:Map Features in OpenStreetMap with Computer Vision by akimbostrawman on Tuesday March 25, 2025 @08:56AM (#43470624)
I know at this point it's almost one of Mozilla's mottos to be horrible at communication but how come nobody felt the need to maybe talk about stuff like this before publishing it?