News for hackers. Stuff that matters.
Re:Using mmap to make LLaMA load faster by jerf on Wednesday April 05, 2023 @01:23PM (#35457520)
"Blatant lie" seems a bit strong. Running a large model for a second time in a row is a pretty common use case and that speedup strikes me as real in that common case. Attribution may have been wrong but the time saved is real.
Re:Using mmap to make LLaMA load faster by gmork13 on Wednesday April 05, 2023 @03:54PM (#35459576)
So it can load twice as large models somehow?