News for hackers. Stuff that matters.
Re:Cerebras Launches Qwen3-235B, Achieving 1,500 Tokens per ... by throwawaymaths on Wednesday July 23, 2025 @08:54AM (#44658681)
what are the bandwidth/latency of memoryX? those are the key parameters for inference
Re:Cerebras Launches Qwen3-235B, Achieving 1,500 Tokens per ... by Zenst on Wednesday July 23, 2025 @09:24AM (#44658982)
Well MemoryX compared to H100 HBM3 the key details are that MemoryX has lower latency, but also far lower bandwidth. However the memory on Cerebras is scales a lot more over NVidia. You need a cluster of H100's to create a model, as only way to scale the memory, Cerbras is more suited to that aspect, Nvidia do their scaling in tooling, with Cerbras doing theirs in design via there silicon approach.

That's my take on it all, not many apples to oranges comparisons to work from on these two system for even rolling down the same slope.

Re:Cerebras Launches Qwen3-235B, Achieving 1,500 Tokens per ... by perfobotto on Wednesday July 23, 2025 @09:45AM (#44659185)
No way an offchip HBM has same or better bandwidth then onchip
Re:Cerebras Launches Qwen3-235B, Achieving 1,500 Tokens per ... by 0xCMP on Wednesday July 23, 2025 @11:15AM (#44660158)
> MemoryX has lower latency, but also far lower bandwidth