News for hackers. Stuff that matters.

A comment on How to crawl a quarter billion webpages in 40 hours. Parent comment

Re:How to crawl a quarter billion webpages in 40 hours by binarysolo on Saturday August 11, 2012 @07:58PM (#4371355)
Gray hat question out of curiosity and possible experience: did you also use proxies or perhaps even Tor?
[ Parent | on HN ]

There are no comments on this comment yet.