News for hackers. Stuff that matters.

A comment on Google is the only search engine that works on Reddit now thanks to AI deal. Parent comment

Re:Google is the only search engine that works on Reddit now... by JohnFen on Wednesday July 24, 2024 @03:53PM (#41061247)
Sadly true. That's why I gave up on robots.txt years ago and started blocking crawlers outright in .htaccess

Of course, that became unsustainable so now I have everything behind a login wall.

[ Parent | on HN ]

There are no comments on this comment yet.