Re:Using mmap to make LLaMA load faster
by VadimPR on Saturday April 08, 2023 @03:03AM
(#35491208)
The feature to load a % to the GPU is novel and amazing! I couldn't get the project up and running myself (requires a nightly rust build) but I love this particular innovation.
[ Parent
| on HN ]
There are no comments on this comment yet.