News for hackers. Stuff that matters.
Re:Using mmap to make LLaMA load faster by danieldk on Wednesday April 05, 2023 @02:51PM (#35458790)
Word embeddings were big for their time (especially with subword embeddings like fastText). We mmaped word embeddings for similar reasons. But yeah, I was kinda surprised that one post about LLaMa.cpp mmap support talked about a 'fairly new technique'. mmap has been in a UNIX programmer's tool belt for literally decades.

There are no comments on this comment yet.