Ask HN: What has HN given you?

Re:Ask HN: What has HN given you? by chipperyman573 on Sunday February 18, 2018 @11:22PM (#16410727)

You wouldn't even need to mine it - https://github.com/HackerNews/API

[ Parent | on HN ]

Re:Ask HN: What has HN given you? by fhoffa on Sunday February 18, 2018 @11:53PM (#16410838)

Even easier: All Hacker News posts are ready to be analyzed in BigQuery.

- https://medium.com/@hoffa/hacker-news-on-bigquery-now-with-d...

[ Parent | on HN ]

Re:Ask HN: What has HN given you? by applecrazy on Sunday February 18, 2018 @11:42PM (#16410799)

Sorry, I meant analyze. I actually am writing a blog post right now on this (this thread was very inspiring). Should be up in a day or two at https://applecrazy.github.io/blog

[ Parent | on HN ]

Re:Ask HN: What has HN given you? by Majora320 on Sunday February 18, 2018 @11:52PM (#16410830)

Good luck downloading 16 million records...

[ Parent | on HN ]

Re:Ask HN: What has HN given you? by kuschku on Monday February 19, 2018 @03:45PM (#16415598)

Why? 16 million isn’t much, maybe 10 to 20 gigabyte if compressed.

I’ve seen IRC bouncers that have more messages stored for a single user (270 million, in fact).

[ Parent | on HN ]

Re:Ask HN: What has HN given you? by minimaxir on Monday February 19, 2018 @12:26AM (#16410944)

You could do that with the Algolia API: https://github.com/minimaxir/get-all-hacker-news-submissions...

But as noted, BigQuery is more pragmatic.

[ Parent | on HN ]

Re:Ask HN: What has HN given you? by abhishekjha on Wednesday February 21, 2018 @12:09AM (#16427008)

I have a script running on aws right now.

[ Parent | on HN ]