Re:I Run LLMs Locally
by elorant on Sunday December 29, 2024 @06:55PM
(#42544770)
Not always, because system RAM also has to be equally adequate, but mostly yes, it's about the total VRAM of the GPU(s).
[ Parent
| on HN ]
There are no comments on this comment yet.