News for hackers. Stuff that matters.

A comment on How to crawl a quarter billion webpages in 40 hours. Parent comment

Re:How to crawl a quarter billion webpages in 40 hours by bigiain on Saturday August 11, 2012 @08:40AM (#4369986)
Backup/archive, where uploading data is frequent and downloading it is only very occasionally required.
[ Parent | on HN ]

There are no comments on this comment yet.