Re:Chiplet ASIC supercomputers for LLMs like GPT-4
by cubefox on Wednesday July 12, 2023 @09:31AM
(#36694259)
> Cerebras achieves 100% yield by designing a system in which any manufacturing defect can be bypassed – initially Cerebras had 1.5% extra cores to allow for defects, but we’ve since been told this was way too much as TSMC's process is so mature.
Re:Chiplet ASIC supercomputers for LLMs like GPT-4
by senttoschool on Wednesday July 12, 2023 @09:55AM
(#36694561)
I'm well aware of chip defect rates and how they affect chips.
>It's sexy and enticing. If someone can make it work that's awesome. I will remain skeptical though.
But Cerebras has made it work since 2019 as @cubefox pointed out. They're on the second generation already and they have been shipping to customers for years.
Here's a good overview of how they did it: https://www.anandtech.com/show/14758/hot-chips-31-live-blogs...
Look at how successful AMD's chiplet strategy has been. Chiplets sidestep the yield problems. Wafer scale amplifies them hundred or thousand fold.
Nothing in the industry is designed to work with wafer scale products, so everything has to be custom made. Yes this is a chicken-egg problem, but it's going to be expensive to get any sort of momentum. The silicon industry is extremely conservative.