News for hackers. Stuff that matters.
Re:Cerebras Launches Qwen3-235B, Achieving 1,500 Tokens per ... by Adfeldman on Wednesday July 23, 2025 @11:18AM (#44660193)
Our chips don't cost $3M. I'm not sure where you got that number but its wildly incorrect.
Re:Cerebras Launches Qwen3-235B, Achieving 1,500 Tokens per ... by aurareturn on Wednesday July 23, 2025 @11:57AM (#44660667)
So how much does it cost? Google search return $3m. Here's your chance to tell us your real price if you disagree.
Re:Cerebras Launches Qwen3-235B, Achieving 1,500 Tokens per ... by 1W6MIC49CYX9GAP on Wednesday July 23, 2025 @12:47PM (#44661262)
He also didn't argue about the rest of the math so it's likely correct that the whole model needs to be in SRAM :)
Re:Cerebras Launches Qwen3-235B, Achieving 1,500 Tokens per ... by qualeed on Wednesday July 23, 2025 @11:59AM (#44660690)
In that case, mind providing a more appropriate ballpark?
Re:Cerebras Launches Qwen3-235B, Achieving 1,500 Tokens per ... by npsomaratna on Wednesday July 23, 2025 @11:43AM (#44660501)
Are you the CEO of Cerebras? (Guessing from the handle)
Re:Cerebras Launches Qwen3-235B, Achieving 1,500 Tokens per ... by rajnathani on Thursday July 24, 2025 @06:08AM (#44668963)
I wonder why he (Andrew Feldman) didn't retort to the SRAM vs HBM memory incorrect assumption made by the OP comment; maybe he was so busy that he couldn't even cite the sibling comment? That's a bigger wrong assumption than being off by maybe 30-50% at most on Cerebras's single server price (it definitely doesn't cost less than $1.5-2M).
Re:Cerebras Launches Qwen3-235B, Achieving 1,500 Tokens per ... by aurareturn on Thursday July 24, 2025 @11:02AM (#44671561)
Probably because they are loading the entire model into SRAM. Thats how they can achieve 1.5k tokens/s.
Re:Cerebras Launches Qwen3-235B, Achieving 1,500 Tokens per ... by benderbreaker on Sunday July 27, 2025 @07:04PM (#44705513)
I have followed Cerebras for sometime. Several comments: 1. Yes I think that is Feldman. I have seen him intervene at hacerknews before thou don't remember the handle specifically 2. Yes, the OP technical assumption is generally correct. Cerebras load the model onto the wafer to get the speed. It's the whole point of their architecture to minimize the distance between memory and compute. They can do otherwise in a "low cost" model, they announced something like that in a partnership with Qualcomm that AFAIK has never been implemented. But it would not be a high-speed mode. 3. The OP is also incorrect on the costs. They pick these costs up from dated customer quotation seen online (in which the Cerebras has incentive to jack it up), but this is not how anything works commercially, and at that time Cerebras was at much smaller scale. But you wouldn't expect Feldman to tell you what their actual costs are. That would be nuts. My thinking is the number could be off by up to 80% by now assuming Cerebras was making progress in their cost curve and the original number had very high margins (which it must have).
Re:Cerebras Launches Qwen3-235B, Achieving 1,500 Tokens per ... by UltraSane on Wednesday July 23, 2025 @01:58PM (#44662077)
Is it actually $4M?
Re:Cerebras Launches Qwen3-235B, Achieving 1,500 Tokens per ... by cgdl on Wednesday July 23, 2025 @02:38PM (#44662514)
Do you distinguish betwen "chips" and the wafer-scale system? Is the wafer-scale system significantly less than 3MM?

EDIT: online it seems TSMC prices are about 25K-30K per wafer. So even 10Xing that a wafer-scale system should be about 300K.

Re:Cerebras Launches Qwen3-235B, Achieving 1,500 Tokens per ... by agentastic on Wednesday July 23, 2025 @06:39PM (#44664771)
Congrats on Qwen3 launch, also ty for the exploration tier. Makes our life a lot easier.

Any plan/ETA on launching it's big-brother (Qwen3-code)?

Re:Cerebras Launches Qwen3-235B, Achieving 1,500 Tokens per ... by benderbreaker on Sunday July 27, 2025 @07:32PM (#44705682)
Agree. The OP is picking from dated and not exactly applicable data. I estimate you could be down to 20% of that by now if you were optimizing for costs. An issue that is real for you guys is software stack tractability; i.e. the ability of your team to bring on board models in a timely manner. Maybe because all models are optimized for GPUs, but it's something that I would get on top of if its fixable. Obviously, you must be taking into account these issues and competitive performance in future iterations of your chips also.