News for hackers. Stuff that matters.
Re:Track HN: Survival Rate of 120,396 Show HN Stories (June ... by xnx on Tuesday June 13, 2023 @03:14PM (#36315409)
I second this. You've done a great service to collect this data. I'm guessing the file must be much smaller than 20GB when compressed.
Re:Track HN: Survival Rate of 120,396 Show HN Stories (June ... by zX41ZdbW on Tuesday June 13, 2023 @05:56PM (#36318123)
It is only around 5 GB in ClickHouse. Details: https://github.com/ClickHouse/ClickHouse/issues/29693
Re:Track HN: Survival Rate of 120,396 Show HN Stories (June ... by zX41ZdbW on Tuesday June 13, 2023 @05:58PM (#36318145)
I've also did an experiment by generating and searching embeddings for all the comments on HN. Here is the walkthrough: https://www.youtube.com/watch?v=hGRNcftpqAk