News for hackers. Stuff that matters.

A comment on Google is the only search engine that works on Reddit now thanks to AI deal. Parent comment

Re:Google is the only search engine that works on Reddit now... by latexr on Thursday July 25, 2024 @06:30AM (#41066915)
That’s a weird statement to be absolutist about. The majority of individuals and companies who want to be successful do not do so by scrapping websites, thus have no reason to disobey robots.txt. Most people in the world, ambitious or not, wouldn’t even understand what your sentence refers to.
[ Parent | on HN ]
Re:Google is the only search engine that works on Reddit now... by wsve on Thursday July 25, 2024 @06:49PM (#41074284)
OP is obviously talking about people whose area of research/development/product would involve web scraping... This feels like being purposefully obtuse
[ Parent | on HN ]