News for hackers. Stuff that matters.
Re:Books in .txt format for AI training purposes by Voloskaya on Sunday October 25, 2020 @07:32PM (#24891142)
And again, I find books3 extremely cool and important work on your part, looking forward to the rest.

I just have a minor gripe with saying that "now we can train world class GPT model" thanks to that, as you said it's just one piece, and as a typicial HNist I had to point it out :).

Re:Books in .txt format for AI training purposes by sillysaurusx on Sunday October 25, 2020 @07:46PM (#24891257)
Believe it or not, I appreciate and relate to that sentiment.

But after spending roughly one year acquiring knowledge related to this work, I feel I can say with a fairly high degree of certainty that this dataset alone is enough to train a model that will achieve "world class" status in some area. Writing books, perhaps.

Which part of my logic do you feel is mistaken, and why? I am actually quite interested to hear thoughts from someone who is very pedantic about such things.

Re:Books in .txt format for AI training purposes by Voloskaya on Sunday October 25, 2020 @08:00PM (#24891347)
I don't think you are mistaken, I guess it's just that there is just so much information you can convey in a tweet, when I read "world class GPT model" I understand a model that will beat (or equal) on general NLG, which is not what you meant it seems.