News for hackers. Stuff that matters.

A comment on Cloudflare Crawl Endpoint. Parent comment

Re:Cloudflare Crawl Endpoint by azinman2 on Wednesday March 11, 2026 @12:41AM (#47331797)
They say they obey robots.txt - isn’t that the easier way?
[ Parent | on HN ]

There are no comments on this comment yet.