Re:Google's robots.txt
by datawander on Sunday February 23, 2014 @02:25PM
(#7287173)
Actually, robot traffic accounts for a much larger share of traffic for any of the big websites than you think.
[ Parent
| on HN ]
There are no comments on this comment yet.