Re:Cerebras achieves 2,500T/s on Llama 4 Maverick (400B)
by ryao on Saturday May 31, 2025 @07:10PM
(#44147584)
I had been unaware of the others. Anyway, you need writes to the KV cache for every token generated. You are going to hit that fast.
[ Parent
| on HN ]
There are no comments on this comment yet.