Re:What Google Won't Let MS Click
by Goladus on Wednesday September 12, 2007 @10:08PM
(#54114)
robots.txt is not a security feature. It's a courtesy that saves resources and makes life a lot easier for everyone who is willing to play by the rules.
[ Parent
| on HN ]
There are no comments on this comment yet.