News for hackers. Stuff that matters.
Re:Cerebras achieves 2,500T/s on Llama 4 Maverick (400B) by latchkey on Saturday May 31, 2025 @06:16PM (#44147316)
> There are many companies that sell tokens from an API

I was just at Dell Tech World and they proudly displayed a slide during the CTO keynote that said:

"Cost per token decreased 4 orders of magnitude"

Personally speaking, not a business I'd want to get into.

Re:Cerebras achieves 2,500T/s on Llama 4 Maverick (400B) by ryao on Saturday May 31, 2025 @07:05PM (#44147557)
Some context is needed for this. The only way to get a 4 orders of magnitude difference would be to compare incomparable things, like OpenAI’s most expensive model versus llama 3.1 8B.