Re:Robots.txt is a suicide note
by thyrsus on Tuesday May 10, 2011 @01:25AM
(#2531466)
I remember some anti-spam vigilante code that told legitimate bots to go away with robots.txt, told humans what the game was about, and attacked e-mail address scrapers by presenting an infinite number of fake e-mail addresses.
"Click here for 1000 more e-mail addresses that will never bother a human!".
[ Parent
| on HN ]
Re:Robots.txt is a suicide note
by rachelbythebay on Tuesday May 10, 2011 @02:05AM
(#2531553)
Not all of them were fake. Some of them were spam traps which never appeared anywhere else. Some of those spam traps were also coded so you could track down when they were served to connect the spiders to the spewers.
At least, that's the way I used to roll.