Re:Kimi Linear: An Expressive, Efficient Attention Architecture
by storus on Tuesday July 28, 2026 @04:37PM
(#49089605)
There was a presentation at CS 25 Transformers United about some phenomena like chain-of-thought emerging only after training LLMs with at least 1T tokens and only in LLMs of certain size.
https://youtu.be/tVtOevLrt5U?t=923