News for hackers. Stuff that matters.

A comment on Tenstorrent unveils Grayskull, its RISC-V answer to GPUs. Parent comment

Re:Tenstorrent unveils Grayskull, its RISC-V answer to GPUs by dannyw on Sunday March 10, 2024 @01:50PM (#39661028)
Why are they so skimpy on memory capacity? I guess this is a dev kit for anything but LLMs?
[ Parent | on HN ]
Re:Tenstorrent unveils Grayskull, its RISC-V answer to GPUs by marty1885 on Monday March 11, 2024 @05:02AM (#39665997)
Grayskull is make before LLMs being a thing. And their plan is like Groq, to distribute the compute graph across multiple processors to get higher effective memory and throughput by pipelining. But better-ish by having RAM so you can fit models on much less cards. Grayskull doesn't have this ability. The next generation Wormhole does by having 100GbE interfaces on the cards.

Also the CPUs on Grayskull is 32bit. Memory is addressed through the bank address so it works for now. But they'll have to upgrade to 64bit soon.

[ Parent | on HN ]