Re:13ft – A site similar to 12ft.io but is self hosted
by WatchDog on Monday August 19, 2024 @09:40PM
(#41296048)
Sure, that's one option, and I don't have any insight into what nyt actually does with regards to it's handling of googlebot traffic.
But if I were implementing filtering, I might prefer a solution that doesn't require keeping a whitelist up to date.
Re:13ft – A site similar to 12ft.io but is self hosted
by Gooblebrai on Tuesday August 20, 2024 @02:09AM
(#41297243)
The whitelist can be updated asynchronously
Why would it be slow? There is a JSON documenbt that lists all IP ranges on the same page you linked to:
https://developers.google.com/static/search/apis/ipranges/go...