News for hackers. Stuff that matters.

A comment on Reddit has updated its robots.txt to block all web crawlers.

Re:Reddit has updated its robots.txt to block all web crawlers by b3ing on Thursday July 04, 2024 @07:32AM (#40874051)
I figured it was to warn people not to use “their” data for AI. The data belongs to their users though
[ Parent | on HN ]

There are no comments on this comment yet.