Re:Google's robots.txt
by Moru on Sunday February 23, 2014 @05:55PM
(#7288064)
Lucky you with only 400+ per day. We had thousands per hour. Still the server survived but it wasn't fast...
[ Parent
| on HN ]
There are no comments on this comment yet.