Re:Why MMAP in llama.cpp hides true memory usage
by Jasper_ on Tuesday April 04, 2023 @10:25AM
(#35440167)
LLAMA maps a single read-only file at startup. The only caveat that applies here is the virtual filesystems one, and it's a fair assessment, so a fallback might be warranted, but mmap seems fine by default.
[ Parent
| on HN ]
There are no comments on this comment yet.