News for hackers. Stuff that matters.

A comment on Chiplet ASIC supercomputers for LLMs like GPT-4. Parent comment

Re:Chiplet ASIC supercomputers for LLMs like GPT-4 by kraken12 on Wednesday July 12, 2023 @05:29PM (#36701942)
The 4090 has half the memory bandwidth, so it could not get a 5X gain, it would actually run slower on a memory bound LLM like this.
[ Parent | on HN ]
Re:Chiplet ASIC supercomputers for LLMs like GPT-4 by why_only_15 on Thursday July 13, 2023 @12:53AM (#36705146)
5x gain per dollar
[ Parent | on HN ]