Re:Llama.cpp 30B runs with only 6GB of RAM now
by microtherion on Friday March 31, 2023 @09:57PM
(#35396256)
> htop still reports only like 4GB of RAM is in use
I think that's just an accounting thing. Many UNIX variants will not "charge" read only memory mapped pages to a process, because they could be shared among many processes and evicted at will.
I think that's just an accounting thing. Many UNIX variants will not "charge" read only memory mapped pages to a process, because they could be shared among many processes and evicted at will.