News for hackers. Stuff that matters.
Re:102TB of New Crawl Data Available by froo on Wednesday November 27, 2013 @11:27PM (#6813016)

  s3cmd ls s3://aws-publicdatasets/common-crawl/crawl-data/CC-MAIN-2013-20/segments/
That should get you about 90% on your way.

There are no comments on this comment yet.