Re:Cloudflare's new AI traffic options for customers
by weird-eye-issue on Sunday July 26, 2026 @01:21AM
(#49054974)
If a site cannot handle traffic from the real Googlebot that is a serious issue with the site itself since it's actually pretty conservative
Also I should note there are lots of fake Googlebots...
Re:Cloudflare's new AI traffic options for customers
by remus on Sunday July 26, 2026 @02:23AM
(#49055317)
Indeed, I've got a site which gets a lot of bot traffic and google bot is pretty sensible compared to a lot of other mainstream bots.
Re:Cloudflare's new AI traffic options for customers
by weird-eye-issue on Sunday July 26, 2026 @05:24AM
(#49056236)
Yes, it really does not make that many requests. In fact lots of site owners struggle with having it not crawl and index their site enough
Re:Cloudflare's new AI traffic options for customers
by 20k on Sunday July 26, 2026 @07:59AM
(#49057233)
It is mostly, but it doesn't take a lot of googling to find sites getting ridiculous amounts of traffic from googlebot on google IPs. Its one of the most common complaints about google's search indexing
Re:Cloudflare's new AI traffic options for customers
by weird-eye-issue on Sunday July 26, 2026 @09:06AM
(#49057814)
Lots of people abuse Google Cloud to get a "Google IP" for a fake Googlebot. Why don't you show me a single screenshot from Google Search Console showing a high number of requests to a site that would be counted as a DoS? All requests from the official Googlebot are logged there so if it's such a common problem it must be very easy for you to show me this.
Re:Cloudflare's new AI traffic options for customers
by weird-eye-issue on Tuesday July 28, 2026 @07:02AM
(#49082093)
Still waiting for a single shred of evidence ;)
This is unfortunately nothing new. There's no correct way to tell them to fuck off, they do not care, and they never will do. People have even taken them to court over this