News for hackers. Stuff that matters.
Re:How to Scale Your Model: A Systems View of LLMs on TPUs by swyx on Wednesday February 05, 2025 @01:45AM (#42944784)
it's quite true. the convergence of all archs to transformers is well documented by karpathy. SSMs were once touted as transformer killers, but increasingly look like just optional supplements.

There are no comments on this comment yet.