News for hackers. Stuff that matters.
Re:Cloudflare's new AI traffic options for customers by bobbiechen on Sunday July 26, 2026 @01:27AM (#49055002)
The vast majority of Googlebot user agents are lying. Real Googlebot is pretty well behaved in my experience. You should use reverse DNS or IP lists to check: https://developers.google.com/crawling/docs/crawlers-fetcher...
Re:Cloudflare's new AI traffic options for customers by simondotau on Sunday July 26, 2026 @09:53AM (#49058272)
If you're using Cloudflare, set up a security rule to block requests that have "Googlebot" in the UA and are not recognised by CF as a real bot.