News for hackers. Stuff that matters.
Re:Google's robots.txt by datawander on Sunday February 23, 2014 @02:25PM (#7287173)
Actually, robot traffic accounts for a much larger share of traffic for any of the big websites than you think.

There are no comments on this comment yet.