Re:I Run LLMs Locally
by fnqi8ckfek on Sunday December 29, 2024 @05:21PM
(#42543925)
I know nothing about gpus. Should I be assuming that when people say "ram" in the context of gpus they always mean vram?
Not always, because system RAM also has to be equally adequate, but mostly yes, it's about the total VRAM of the GPU(s).
I don’t have experience with AMD cards so I can’t vouch for them.