News for hackers. Stuff that matters.
Re:Show HN: Download the first 10,002,378 HN comments/storie... by ivan_ah on Tuesday August 04, 2015 @08:38AM (#10002944)
> 10,002,378

what date range does this correspond to? How big is the archive?

Re:Show HN: Download the first 10,002,378 HN comments/storie... by cdman on Tuesday August 04, 2015 @08:44AM (#10002988)
It is from story 1 to comment/story 10,002,378 :-)

The archive is 1.12GB big and contains 1 JSON document / per line. The JSON document is approximately the format returned by the official HN API (although there are some exceptions since some of the comments are not available through the official API and those had to be retrieved through the Algolia API and/or scraped from the site).

Re:Show HN: Download the first 10,002,378 HN comments/storie... by ivan_ah on Tuesday August 04, 2015 @08:57AM (#10003070)
Thx. Great job. Now I just have to dust off some LDA code and see some topics...
Re:Show HN: Download the first 10,002,378 HN comments/storie... by cdman on Tuesday August 04, 2015 @08:46AM (#10003007)
Also, about the date range: from October 10, 2006 until yesterday (when HN hit ~10m comments / stories).