News for hackers. Stuff that matters.
Re:Tiny Language Models Come of Age by fnordpiglet on Sunday October 08, 2023 @12:59PM (#37812243)
That doesn’t mean that a much larger with high quality training data and new training techniques won’t be more powerful than a smaller model. We have incredible efficiencies in modern computers in addition to immense resources. They both are needed for the best performance. I suspect it’s the same for LLM. Superior data, superior techniques, and superior scale will yield superior models.

There are no comments on this comment yet.