News for hackers. Stuff that matters.

A comment on Reddit has updated its robots.txt to block all web crawlers. Parent comment

Re:Reddit has updated its robots.txt to block all web crawlers by rbetts on Thursday July 04, 2024 @08:59AM (#40874580)
I wonder if these indexing deals will become more antitrust evidence.
[ Parent | on HN ]

There are no comments on this comment yet.