News for hackers. Stuff that matters.

A comment on Reddit has updated its robots.txt to block all web crawlers.

Re:Reddit has updated its robots.txt to block all web crawlers by nojvek on Thursday July 04, 2024 @08:13AM (#40874260)
Reddit making deals with search engines and AI companies for millions of dollars.

Public data belong to Reddit to sell. Makes sense, why would they give it away for free when they can charge for it.

[ Parent | on HN ]

There are no comments on this comment yet.