News for hackers. Stuff that matters.

A comment on Tell HN: Full Hacker News dataset now available on BigQuery. Parent comment

Re:Tell HN: Full Hacker News dataset now available on BigQuery by minimaxir on Friday October 23, 2015 @03:47PM (#10440888)
That will not get you accurate results for HN data analysis since a) those accounts only tweet important links so analysis will be biased b) you can only get 3200 tweets at a time. (This is a Twitter API limitation)

You have to look at both the good and the bad.

[ Parent | on HN ]
Re:Tell HN: Full Hacker News dataset now available on BigQuery by nsmalch on Friday October 23, 2015 @03:59PM (#10440961)
I hear you. Raw unfiltered links always have hidden gems.

One thing though: Greptweet has an archive somewhere with a huge trove of tweets that users of the service have searched for, and were thus logged and kept. (Some even go over the 3200 limit). It's a massive Tarball, so set aside time to download it and parse out boring/noisy links.

A lot of HN links are tech-press posts which consist of hearsay and merely proxy the thoughts of others. The recent changes in HN with regards to more academia-style posts is refreshing.

[ Parent | on HN ]