Re:How to Scale Your Model: A Systems View of LLMs on TPUs
by swyx on Wednesday February 05, 2025 @01:45AM
(#42944784)
it's quite true. the convergence of all archs to transformers is well documented by karpathy. SSMs were once touted as transformer killers, but increasingly look like just optional supplements.
[ Parent
| on HN ]
There are no comments on this comment yet.