Re:Cerebras achieves 2,500T/s on Llama 4 Maverick (400B)
by rkomorn on Saturday May 31, 2025 @02:58PM
(#44146275)
Doesn't 1.2Tbps / 8 = 150 GBps because 8b = 1B ?
[ Parent
| on HN ]
Re:Cerebras achieves 2,500T/s on Llama 4 Maverick (400B)
by moralestapia on Saturday May 31, 2025 @03:03PM
(#44146303)
That's ... right! Huh, missed that (assuming all units were written properly and mean what they mean).
Edit: yeah, double checked their site and everything. Dang, their IO is indeed "slow". They claim 1 microsecond latencies, but still, an H100 can move much more data than that.