Re:Cerebras Code
by supernova8 on Friday August 01, 2025 @07:08PM
(#44763436)
How is this even possible?
[ Parent
| on HN ]
Re:Cerebras Code
by kristopolous on Friday August 01, 2025 @07:10PM
(#44763451)
It's their own hardware : https://www.cerebras.ai/blog/cerebras-cs3
Re:Cerebras Code
by unshavedyak on Friday August 01, 2025 @07:41PM
(#44763620)
Incase i'm missing something, why wouldn't it be possible?
Claude and Gemini have similar offerings for a similar/same price, i thought. Eg if Claude Code can do it for $200/m, why can't Cerebras?
(honest question, trying to understand the challenge for Cerebras that you're pointing to)
edit: Maybe it's the speed? 2k tokens/s sounds... fast, much faster than Claude. Is that what you're referring to?
Re:Cerebras Code
by UnPerson-Alpha2 on Saturday August 02, 2025 @01:54AM
(#44765173)
He just wrote another way of making an exclamation, like "wow, incredible!".
They make frisbee-sized CPUs.
Indeed. Pretty much all silicon today comes on 12" or so wafers, broken into chip sized pieces, and each chip is tested and the ones that failed are thrown away.
Cerebras uses the entire 12" and builds in redundancy so that with current defect rates a large fraction of the wafers are usable. This allows a huge level of parallelism, a large amount of on board ram, and the removal of the need to move data on/off the wafer. So the available bandwidth is insane and inference is mostly bandwidth limited.