News for hackers. Stuff that matters.
Re:Llama.cpp 30B runs with only 6GB of RAM now by terafo on Friday March 31, 2023 @06:31PM (#35394635)
It is a good candidate. Tech is good 6-18 months away, though.
Re:Llama.cpp 30B runs with only 6GB of RAM now by nullsense on Friday March 31, 2023 @07:35PM (#35395229)
How much faster can we develop the tech if we leverage GPT-4 to do it?