Re:Cerebras achieves 2,500T/s on Llama 4 Maverick (400B)
by ryao on Saturday May 31, 2025 @07:05PM
(#44147557)
Some context is needed for this. The only way to get a 4 orders of magnitude difference would be to compare incomparable things, like OpenAI’s most expensive model versus llama 3.1 8B.
I was just at Dell Tech World and they proudly displayed a slide during the CTO keynote that said:
"Cost per token decreased 4 orders of magnitude"
Personally speaking, not a business I'd want to get into.