News for hackers. Stuff that matters.
Re:Why MMAP in llama.cpp hides true memory usage by Jasper_ on Tuesday April 04, 2023 @10:25AM (#35440167)
LLAMA maps a single read-only file at startup. The only caveat that applies here is the virtual filesystems one, and it's a fair assessment, so a fallback might be warranted, but mmap seems fine by default.

There are no comments on this comment yet.