Re:Ask HN: How are you dealing with scraping hits from EC2 m...
by bdcravens on Wednesday December 12, 2012 @09:45AM
(#4910237)
You'd end up blocking all traffic then. When was was the last time you pulled robots.txt?
[ Parent
| on HN ]
There are no comments on this comment yet.