Re:Chiplet ASIC supercomputers for LLMs like GPT-4
by brucethemoose2 on Wednesday July 12, 2023 @09:43PM
(#36704080)
Yes, that because Cerebras's "chip" is actially an entire wafer many GPUs would normally be carved out of.
The extra stuff TSMC must do to pull that off are probably expensive... But I can't imagine it being, say, 10x more expensive than a wafer full of reticle sized dies (like Nvidia does). And thats setting aside the massive IO advantage of Cerebras's mega die.
The extra stuff TSMC must do to pull that off are probably expensive... But I can't imagine it being, say, 10x more expensive than a wafer full of reticle sized dies (like Nvidia does). And thats setting aside the massive IO advantage of Cerebras's mega die.