News for hackers. Stuff that matters.
Re:Cerebras achieves 2,500T/s on Llama 4 Maverick (400B) by ryao on Saturday May 31, 2025 @07:10PM (#44147584)
I had been unaware of the others. Anyway, you need writes to the KV cache for every token generated. You are going to hit that fast.

There are no comments on this comment yet.