Re:Using mmap to make LLaMA load faster
by pantalaimon on Wednesday April 05, 2023 @01:20PM
(#35457476)
Is mmap really that broken on Windows? Or is the poster just confused that the data stays in the page cache? But that’s what the page cache does - that memory will be used for other things if needed, but if the memory is not needed it might as well keep the old data in cache.
[ Parent
| on HN ]
Re:Using mmap to make LLaMA load faster
by Analemma_ on Wednesday April 05, 2023 @01:23PM
(#35457525)
No, mmap on Windows is fine. A generous, charitable statement would be that the OP on that thread is very confused, but based on some comments elsewhere on this thread about jart attracting a chorus of haters, it seems more likely that they're just trolling.
Re:Using mmap to make LLaMA load faster
by tedunangst on Wednesday April 05, 2023 @02:09PM
(#35458214)
There's a weird breed of programmer who only wants to see the free memory column in top be maximized. I bought all this RAM and I want to make sure none of it is used in case I want to use it later.