News for hackers. Stuff that matters.
Re:Robots.txt meant for search engines don’t work well for w... by problems on Friday April 21, 2017 @11:25AM (#14166373)
Precisely - the solution here needs to be that the server blocks the robot - if it can differentiate it from other traffic that is. That's all well and good and that's the solution which should be used here. If you don't want to be archived, block the IP.

There are no comments on this comment yet.