Re:Google No Longer Automatically Indexes Websites – WTF?
by el_snark on Monday June 05, 2023 @12:06PM
(#36198378)
I've got a script for parsing my web logs which removes all the lines which match persistent indexers/bots/scrapers and any obvious automatons. Logs generally shrink to 40-50% of their volume, so I'd at least double CF's estimate.
[ Parent
| on HN ]
There are no comments on this comment yet.