Re:Using mmap to make LLaMA load faster
by danieldk on Wednesday April 05, 2023 @02:51PM
(#35458790)
Word embeddings were big for their time (especially with subword embeddings like fastText). We mmaped word embeddings for similar reasons. But yeah, I was kinda surprised that one post about LLaMa.cpp mmap support talked about a 'fairly new technique'. mmap has been in a UNIX programmer's tool belt for literally decades.
[ Parent
| on HN ]
There are no comments on this comment yet.