News for hackers. Stuff that matters.

A comment on Chiplet ASIC supercomputers for LLMs like GPT-4.

Re:Chiplet ASIC supercomputers for LLMs like GPT-4 by gautamcgoel on Wednesday July 12, 2023 @08:51AM (#36693798)
Can anyone share how much SRAM their proposed ASIC actually has? I skimmed the paper but that number didn't jump out to me.
[ Parent | on HN ]
Re:Chiplet ASIC supercomputers for LLMs like GPT-4 by punkgenius on Wednesday July 12, 2023 @12:59PM (#36697720)
~200MB to 1GB per ASIC, from Table 2 on page 10.
[ Parent | on HN ]