Re:Using mmap to make LLaMA load faster
by jerf on Wednesday April 05, 2023 @01:23PM
(#35457520)
"Blatant lie" seems a bit strong. Running a large model for a second time in a row is a pretty common use case and that speedup strikes me as real in that common case. Attribution may have been wrong but the time saved is real.
[ Parent
| on HN ]