News for hackers. Stuff that matters.
Re:Botspam apocalypse by jiggawatts on Thursday August 04, 2022 @04:13AM (#32340471)
I would add that link to robots.txt as an exclusion.

That way well-behaved search engines won’t be affected, but naive scrapers get auto-banned.

There are no comments on this comment yet.