Re:Using mmap to make LLaMA load faster
by a5huynh on Wednesday April 05, 2023 @12:32PM
(#35456771)
I recently found this list of models that works with llama.cpp: https://rentry.org/nur779 (with dl links, albeit given llama's licensing gray area, use at your own risk)
The latest so far would be Vicuna, whose weights were just recently release.
The latest so far would be Vicuna, whose weights were just recently release.