Re:Chiplet ASIC supercomputers for LLMs like GPT-4
by JonChesterfield on Wednesday July 12, 2023 @06:55PM
(#36702768)
Having hardware and software talk to each other before tape out is a really good idea. The early Graphcore work was done on a whiteboard with people from both sides writing on it.
There's still a lot of compromises and tradeoffs to be made:
> We observe that the inter-chiplet communication issues can be effectively mitigated through proper software-hardware co- design
Doubtful. Especially given it's all vapourware. Codesign is not adequately magic to handwave away this one.
There's still a lot of compromises and tradeoffs to be made:
> We observe that the inter-chiplet communication issues can be effectively mitigated through proper software-hardware co- design
Doubtful. Especially given it's all vapourware. Codesign is not adequately magic to handwave away this one.