Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on /story/34586940. Parent comment
Running a language model is challenging as it took ~22 hours for training on 30k books and I expect it to take at least a week on M1 GPU.
On Size, I expect 10Mn books to be taking ~16GB storage in my database.
Thanks for your comments and good luck to your data pipeline.
Running a language model is challenging as it took ~22 hours for training on 30k books and I expect it to take at least a week on M1 GPU.
On Size, I expect 10Mn books to be taking ~16GB storage in my database.
Thanks for your comments and good luck to your data pipeline.