Dear AI Companies, instead of scraping OpenStreetMap, how about a $10k donation?

Re:Dear AI Companies, instead of scraping OpenStreetMap, how... by zkid18 on Tuesday July 30, 2024 @12:34PM (#41111060)

Many would oppose the idea, but if any service (e.g. eBay, LinkedIn, Facebook) were to dump the snapshot to S3 every month, that could be a solution. You can't prevent scraping anyway.

[ Parent | on HN ]

Re:Dear AI Companies, instead of scraping OpenStreetMap, how... by Firefishy on Tuesday July 30, 2024 @03:14PM (#41113055)

We publish a live stream of minutely updated OpenStreetMap data in ready do digest form on https://planet.openstreetmap.org/ and S3. Scraping of our data still happens.

Our S3 bucket is thankfully supported by the AWS Open Data Sponsorship Program.

[ Parent | on HN ]

Re:Dear AI Companies, instead of scraping OpenStreetMap, how... by dorgo on Tuesday July 30, 2024 @02:50PM (#41112812)

Would the snapshot contain the same info ( beyound any doubt ) that an actual user would see if they opened LinkedIn/Facebook/Service from Canada on an IPhone at a saturday morning (for example)? If not, the snapshot is useles for some usecases and we are back to scraping.

[ Parent | on HN ]

Re:Dear AI Companies, instead of scraping OpenStreetMap, how... by glitchc on Tuesday July 30, 2024 @12:56PM (#41111367)

Data from S3 isn't free though, still costs money and has a limit based on the tier you purchase.

[ Parent | on HN ]

Re:Dear AI Companies, instead of scraping OpenStreetMap, how... by Scoundreller on Tuesday July 30, 2024 @12:40PM (#41111139)

Yeah, you can get dumps of Wikipedia and stackoverflow/stackexchange that way.

(Not sure if created by the admins or a 3rd party, but done once for many is better than overlapping individual efforts).

[ Parent | on HN ]