News for hackers. Stuff that matters.
Re:The web does not need gatekeepers: Cloudflare’s new “sign... by Symbiote on Friday August 29, 2025 @06:09PM (#45069987)
At present, problem one is almost entirely AI companies.
Re:The web does not need gatekeepers: Cloudflare’s new “sign... by wvenable on Friday August 29, 2025 @06:17PM (#45070052)
And a few decades ago, it would have been search engine scrapers instead.
Re:The web does not need gatekeepers: Cloudflare’s new “sign... by not2b on Friday August 29, 2025 @10:43PM (#45071491)
And that problem was largely solved by robots.txt. AI scrapers are ignoring robots.txt and beating the hell out of sites. Small sites that have decades worth of quality information are suffering the most. Many of the scrapers are taking extreme measures to avoid being blocked, like using large numbers of distinct IP addresses (perhaps using botnets).
Re:The web does not need gatekeepers: Cloudflare’s new “sign... by immibis on Friday August 29, 2025 @10:40PM (#45071482)
There's actually not much evidence of this, since the attack traffic is anonymous.
Re:The web does not need gatekeepers: Cloudflare’s new “sign... by Symbiote on Saturday August 30, 2025 @05:18AM (#45073198)
HN people working in these AI companies have commented to say they do this, and the timing correlates with the rise of AI companies/funding.

I haven't tried to find it in my own logs, but others have said blocking an identifiable AI bot soon led to the same pattern of requests continuing through a botnet.

Re:The web does not need gatekeepers: Cloudflare’s new “sign... by lostmsu on Saturday August 30, 2025 @08:53AM (#45074219)
Did HN people present evidence?