News for hackers. Stuff that matters.

A comment on I protect my forgejo instance from AI Web Crawlers. Parent comment

Re:I protect my forgejo instance from AI Web Crawlers by ethmarks on Monday December 22, 2025 @01:30PM (#46357076)
Maybe a stupid question but how can Cloudflare detect what portion of traffic is coming from LLM agents? Do agents identify themselves when they make requests? Are you just assuming that all playwright traffic originated from an agent?
[ Parent | on HN ]
Re:I protect my forgejo instance from AI Web Crawlers by hombre_fatal on Tuesday December 23, 2025 @08:00AM (#46365003)
That is what Cloudflare's bot metrics dashboard told me before I enabled their "Super Bot Fighter" system that brought traffic back down to its pre-bot levels.

I assume most traffic comes from hosted LLM chats (e.g. chatgpt.com) where the provider (e.g. OpenAI) is making the requests from their own servers.

[ Parent | on HN ]