News for hackers. Stuff that matters.

A comment on Cloudflare adds option to block AI scrapers and crawlers. Parent comment

Re:Cloudflare adds option to block AI scrapers and crawlers by epanchin on Thursday June 27, 2024 @04:29PM (#40814743)
The latter doesn’t request robots.txt
[ Parent | on HN ]

There are no comments on this comment yet.