Re:Cloudflare's new AI traffic options for customers
by bobbiechen on Sunday July 26, 2026 @01:27AM
(#49055002)
The vast majority of Googlebot user agents are lying. Real Googlebot is pretty well behaved in my experience. You should use reverse DNS or IP lists to check: https://developers.google.com/crawling/docs/crawlers-fetcher...
[ Parent
| on HN ]
Re:Cloudflare's new AI traffic options for customers
by simondotau on Sunday July 26, 2026 @09:53AM
(#49058272)
If you're using Cloudflare, set up a security rule to block requests that have "Googlebot" in the UA and are not recognised by CF as a real bot.