News for hackers. Stuff that matters.
Re:The End of AI Frontiers by stymaar on Saturday November 07, 2026 @04:27PM (#50408221)
The Chinchilla paper is probably the poster child of “paper that aged like milk” in LLM field though. Everyone over the past 4 years have trained with several orders of magnitude more data than the Chinchilla optimal number.
Re:The End of AI Frontiers by sroussey on Saturday November 07, 2026 @06:41PM (#50409114)
If you don’t know which data has the highest value, though more at it. Chinchilla is probably still true, but with that caveat. And it could be like advertising… you know a lot of it is worthless, but you don’t know which part.