News for hackers. Stuff that matters.
Re:OpenAI unveils its first custom chip, built by Broadcom by Smaug123 on Wednesday June 24, 2026 @04:21PM (#48665150)
By the way, you've seen Cerebras? It's not gone as far as what you described - loads of cores and RAM but you still load up the weights onto it as software and they need to be streamed into the chip for large models - but it is a whole wafer.
Re:OpenAI unveils its first custom chip, built by Broadcom by trouve_search on Wednesday June 24, 2026 @04:38PM (#48665331)
Cerebras is a whole lot of SRAM, basically a ton more L1/L2 cache, hence increasing throughput.

They're pretty supply constrained right now though and their production costs seem prohibitive.

The interesting players at the moment are from Toronto: taalas (print the model onto the silicon) and tenstorrent (dataflow programming based hardware)

Re:OpenAI unveils its first custom chip, built by Broadcom by londons_explore on Wednesday June 24, 2026 @05:57PM (#48666097)
There is a huge downside to weights being modifiable - it means you need to have multipliers (not simply adders), and SRAM to store those weights.

I suspect for equal performance, that's probably a 5x increase in silicon area (and therefore cost).