Re:States bring action against Google under federal and stat...
by cpeterso on Wednesday December 16, 2020 @08:08PM
(#25451062)
Google probably crawls with non-Googlebot User-Agent strings periodically to test if sites are serving different content to Googlebot and regular browsers.
[ Parent
| on HN ]
Re:States bring action against Google under federal and stat...
by Quekid5 on Wednesday December 16, 2020 @09:03PM
(#25451480)
I have no insider knowledge, but I'm going to guess that they even crawl using actual Chrome browsers once in a while... and penalize deviations from what you serve to the GoogleBot... and also factor in response times for either.
I don't think any single person can predict/know what's actually going on at this point.
Re:States bring action against Google under federal and stat...
by SolarNet on Wednesday December 16, 2020 @08:40PM
(#25451283)
But this mitigation would still fail. They might test for different content, but they probably don't include a periodic test like this in their timing tests, and if they did, it would just be an outlier.