Re:How Google’s Web Crawler Bypasses Paywalls
by slig on Friday February 19, 2016 @01:49PM
(#11135587)
> Also, Google has published IP addresses it uses, so this extension might not last long...
They do not [1], but you can find out by doing a reverse DNS query.
> "Google doesn't post a public list of IP addresses for webmasters to whitelist"
[1] https://support.google.com/webmasters/answer/80553?hl=en
Also, Google has published IP addresses it uses, so this extension might not last long...