News for hackers. Stuff that matters.
Re:Robots.txt is a suicide note by petercooper on Tuesday May 10, 2011 @08:18AM (#2532170)
AT does many, many illegal things. They copy and redistribute content without permission of the owner

I don't know if AT does or does not do anything illegal but what you have outlined is not illegal per se. archive.org and Google do it too.

Re:Robots.txt is a suicide note by meiji on Tuesday May 10, 2011 @08:54AM (#2532272)
But Google do allow an opt-out and follows what AT consider outdated methods of data protection. Doesn't seem that AT is the same.
Re:Robots.txt is a suicide note by stonemetal on Tuesday May 10, 2011 @12:00PM (#2532939)
The old it isn't illegal because bob and joe do it too defense. The behavior of others don't change the legality of your behavior.