Re:I Run LLMs Locally
by fnqi8ckfek on Sunday December 29, 2024 @05:21PM
(#42543925)
I know nothing about gpus. Should I be assuming that when people say "ram" in the context of gpus they always mean vram?
[ Parent
| on HN ]
Not always, because system RAM also has to be equally adequate, but mostly yes, it's about the total VRAM of the GPU(s).