News for hackers. Stuff that matters.

A comment on Robots.txt is a suicide note. Parent comment

Re:Robots.txt is a suicide note by tszming on Tuesday May 10, 2011 @03:40AM (#2531742)
I don't think so. I still receive a lot of requests from Yahoo! Slurp / Yahoo! Slurp China this month.
[ Parent | on HN ]

There are no comments on this comment yet.