News for hackers. Stuff that matters.

A comment on Using mmap to make LLaMA load faster. Parent comment

Re:Using mmap to make LLaMA load faster by astrange on Wednesday April 05, 2023 @03:00PM (#35458905)
Huh, maybe I was thinking of "you can use floating point in the kernel".

That doesn't work in every kernel because they don't want to bother saving/restoring the extra registers.

[ Parent | on HN ]
Re:Using mmap to make LLaMA load faster by saagarjha on Thursday April 06, 2023 @04:29AM (#35465775)
To be entirely honest I'm not sure why the kernel doesn't use better routines here, I think on ARM at least it saves the entire NEON state on context switch…
[ Parent | on HN ]