News for hackers. Stuff that matters.

A comment on Using mmap to make LLaMA load faster. Parent comment

Re:Using mmap to make LLaMA load faster by jjoonathan on Wednesday April 05, 2023 @01:57PM (#35458046)
> least accessed data is paged out

Aren't all the weights touched in every pass?

[ Parent | on HN ]
Re:Using mmap to make LLaMA load faster by marginalia_nu on Wednesday April 05, 2023 @01:59PM (#35458071)
Speaking in general.
[ Parent | on HN ]