News for hackers. Stuff that matters.
Re:The Kimi K3 Moment by kllrnohj on Saturday July 18, 2026 @05:11PM (#48962452)
Because the transformer architecture that enabled modern LLMs wasn't invented until 2017[1]?

1: That's the "T" in GPT fyi, even though Google is the author of the research paper that changed everything

Re:The Kimi K3 Moment by nonethewiser on Saturday July 18, 2026 @05:17PM (#48962519)
Right. So we had enough information to train LLMs but not the technology to build it.

So the initial models arent just distilled from information. We’ve always had the information.

Re:The Kimi K3 Moment by anigbrowl on Saturday July 18, 2026 @09:53PM (#48964313)
Yes, but not the secret of distillation.