Re:Cerebras achieves 2,500T/s on Llama 4 Maverick (400B)
by skryl on Saturday May 31, 2025 @06:25PM
(#44147356)
One caveat is that this paper only covers training, which can be done on a single CS-3 using external memory (swapping weights in and out of SRAM). There is no way that a single CS-3 will hit this record inference performance with external memory so this was likely done with 10-20 CS-3 chips and the full model in SRAM. Definitely can’t compare token/$ with that kind of setup vs a DGX.
[ Parent
| on HN ]
There are no comments on this comment yet.