News for hackers. Stuff that matters.
Re:Google No Longer Automatically Indexes Websites – WTF? by el_snark on Monday June 05, 2023 @12:06PM (#36198378)
I've got a script for parsing my web logs which removes all the lines which match persistent indexers/bots/scrapers and any obvious automatons. Logs generally shrink to 40-50% of their volume, so I'd at least double CF's estimate.

There are no comments on this comment yet.