Re:Remind HN: Go to Noobstories, flag spam
by sorbus on Sunday September 05, 2010 @10:25PM
(#1665664)
One assumes that a core characteristic of spammers and spambots is that they ignore Robots.txt - or at least I would be extremely surprised if disallowing them in robots.txt has any effect.
[ Parent
| on HN ]
There are no comments on this comment yet.