Re:Dear AI Companies, instead of scraping OpenStreetMap, how...
by amiga386 on Tuesday July 30, 2024 @01:02PM
(#41111454)
I liked the analogy to Gabe Newell's "piracy is a service problem" adage, embodied in Virgin API consumer vs Chad third-party scraper https://x.com/gf_256/status/1514131084702797827
Make it easier to get the data, put less roadblocks in the way for legitimate access, and you'll find fewer scrapers. Even if you make scraping _very_ hard, people will still prefer scraping if legitimate use is even more cumbersome than scraping, or you refuse to even offer a legitimate option.
Admittedly, we are talking here because some people are scraping OSM when they could get the entire dataset for free... but I'm hoping these people are outliers, and most consume the non-profit org's data in the way they ask.
Re:Dear AI Companies, instead of scraping OpenStreetMap, how...
by rat9988 on Tuesday July 30, 2024 @01:28PM
(#41111829)
I think this very example proves that the adage is wrong, or at least doesn't capture many things for the full picture.
Re:Dear AI Companies, instead of scraping OpenStreetMap, how...
by pona-a on Tuesday July 30, 2024 @02:46PM
(#41112758)
Well, it isn't a case of piracy, is it? The data exists on the website, for free, under the assumption/social contract that you are a human, not an agent of a shady enterprise wasting the bandwidth. An analogy would be the game itself being put out for free on itch.io, but then downloaded and unpacked to make an asset flip.
Re:Dear AI Companies, instead of scraping OpenStreetMap, how...
by xigoi on Tuesday July 30, 2024 @07:40PM
(#41115171)
Ironic of him to say that seeing that itβs often easier to pirate Steam gates than to get them legitimately.
Re:Dear AI Companies, instead of scraping OpenStreetMap, how...
by thomasahle on Wednesday July 31, 2024 @11:35AM
(#41120116)
The only way I can see to make it truly expensive to scrape, is to build javascript bitcoin mining into every request.
Can defenses be good enough it's better to not even try to fight? It's a far harder question than wondering if a random bot can make a dozen requests pretending to be human