News for hackers. Stuff that matters.

A comment on Micron Kicks Off Production of HBM3E Memory – AnandTech. Parent comment

Re:Micron Kicks Off Production of HBM3E Memory – AnandTech by AnthonyMouse on Wednesday February 28, 2024 @02:49PM (#39542653)
NVLink is most needed for training. For inference a lot of the popular models can usefully be run on multiple GPUs without it:

https://www.reddit.com/r/LocalLLaMA/comments/142rm0m/llamacp...

[ Parent | on HN ]

There are no comments on this comment yet.