News for hackers. Stuff that matters.
Re:Kimi Linear: An Expressive, Efficient Attention Architecture by storus on Tuesday July 28, 2026 @04:37PM (#49089605)
There was a presentation at CS 25 Transformers United about some phenomena like chain-of-thought emerging only after training LLMs with at least 1T tokens and only in LLMs of certain size.

https://youtu.be/tVtOevLrt5U?t=923

There are no comments on this comment yet.