News for hackers. Stuff that matters.
Re:Removing my site from Google search by judge2020 on Sunday October 03, 2021 @03:08PM (#28739699)
The way to check googlebot (in a way that will be resistant to expansion of Googlebot's IP ranges in the future) is to perform hostname lookup, with dns lookup as well to verify that the rDNS isn't a lie: https://developers.google.com/search/docs/advanced/crawling/...
Re:Removing my site from Google search by lucb1e on Sunday October 03, 2021 @03:14PM (#28739749)
Indeed, this was one of the things I considered (note I'm not OP), but then I didn't really want to rely on DNS. https://duckduckgo.com/?q=it's+always+DNS