Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on How Is LLaMa.cpp Possible?. Parent comment
Pick your quantization level depending on how much memory you have and how much speed you need
Run with llama.cpp (or kobold.cpp if you want a convenient webui)
(There is no llama2 65B, it's 70B instead)
There are no comments on this comment yet.
Pick your quantization level depending on how much memory you have and how much speed you need
Run with llama.cpp (or kobold.cpp if you want a convenient webui)
(There is no llama2 65B, it's 70B instead)