News for hackers. Stuff that matters.
Re:Wikidata or Scraping Wikipedia by Minor49er on Monday August 23, 2021 @03:46PM (#28280993)
Absolutely spot-on. It makes me think of my own experience.

I've worked for a few niche search engines. Some sites have APIs available so that you don't have to scrape their data. But often times, since we were already used to scraping sites, we wouldn't even notice that an API was available. In a few number of cases, an API _was_ available, but it was more restrictive or complicated than it was for us to just scrape a page. That's not to say that we never used them, because we certainly did. Just that we often were never aware that they were an option since they were not very common in our cases.

Re:Wikidata or Scraping Wikipedia by Galanwe on Monday August 23, 2021 @08:17PM (#28283714)
Not to mention that APIs come with registration, credentials, rate limiting, throttling, etc.
Re:Wikidata or Scraping Wikipedia by vrandecic on Monday August 23, 2021 @10:23PM (#28284474)
Wikidata's API doesn't require registration, credentials, etc.