News for hackers. Stuff that matters.

A comment on Show HN: I Scraped Hacker News for TLD Popularity.

Re:Show HN: I Scraped Hacker News for TLD Popularity by gryn on Monday March 13, 2023 @09:01AM (#35135126)
you don't need to scrape HN there's the public dataset in google BigQuery, I don't know if it's still updated regularly.

edit:

here's the link https://console.cloud.google.com/marketplace/details/y-combi...

they seems to have stopped updating around the later part of 2022, don't know why.

[ Parent | on HN ]
Re:Show HN: I Scraped Hacker News for TLD Popularity by pfarrell on Monday March 13, 2023 @09:31AM (#35135462)
To anyone interested, I noticed this stoppage as well. IIRC, the data in BigQuery stopped being updated Nov 16, 2022. I’ve got a complete dataset that merges in new content from the firebase dataset, then rectifies story points at a later time (since stories can amass points indefinitely). Comment here if you’re interested. I’m thinking of publishing it as a torrent, but don’t know if there’s enough interest.
[ Parent | on HN ]
Re:Show HN: I Scraped Hacker News for TLD Popularity by codetrotter on Monday March 13, 2023 @10:19AM (#35136045)
> Comment here if you’re interested. I’m thinking of publishing it as a torrent, but don’t know if there’s enough interest.

Please do :)

[ Parent | on HN ]
Re:Show HN: I Scraped Hacker News for TLD Popularity by gbertb on Monday March 13, 2023 @10:44AM (#35136352)
Would be interested as well!
[ Parent | on HN ]
Re:Show HN: I Scraped Hacker News for TLD Popularity by zxexz on Monday March 13, 2023 @10:28AM (#35136147)
I would love that! I find HN useful to have backed up on my laptop, for freetext searching offline mostly.
[ Parent | on HN ]
Re:Show HN: I Scraped Hacker News for TLD Popularity by malborodog on Monday March 13, 2023 @11:37PM (#35147132)
+1
[ Parent | on HN ]
Re:Show HN: I Scraped Hacker News for TLD Popularity by klausbreyer on Monday March 13, 2023 @12:19PM (#35137855)
I also learned this today. Thanks for sharing! :)

Edit: But sadly it is not up to date. :)

[ Parent | on HN ]