News for hackers. Stuff that matters.
Re:Using mmap to make LLaMA load faster by VadimPR on Saturday April 08, 2023 @03:03AM (#35491208)
The feature to load a % to the GPU is novel and amazing! I couldn't get the project up and running myself (requires a nightly rust build) but I love this particular innovation.

There are no comments on this comment yet.