News for hackers. Stuff that matters.
Re:A comprehensive guide to running Llama 2 locally by pdntspa on Wednesday July 26, 2023 @10:07AM (#36877970)
llama.cpp needs the files to be in ggml format, there is a command string you can run to convert one from the other (as well as perform quantization). Or just download the GGML version

https://www.reddit.com/r/LocalLLaMA/wiki/models#wiki_llama_2...

There are no comments on this comment yet.