Re:Wikipedia's robots.txt
by spc476 on Tuesday July 16, 2019 @10:22PM
(#20455862)
Have you checked the IPs to make sure they're actually Google? There's a strong incentive to fake being Google.
[ Parent
| on HN ]