News for hackers. Stuff that matters.

A comment on Inventing Favicon.ico. Parent comment

Re:Inventing Favicon.ico by wareya on Monday March 30, 2015 @08:20AM (#9288975)
The whole point of robots.txt is that there are pages which people may hit that bots can't. What are you on?
[ Parent | on HN ]

There are no comments on this comment yet.