News for hackers. Stuff that matters.
Re:Llama.cpp 30B runs with only 6GB of RAM now by Accujack on Saturday April 01, 2023 @10:35PM (#35406562)
This is not exactly a new problem.
Re:Llama.cpp 30B runs with only 6GB of RAM now by AnthonyMouse on Saturday April 01, 2023 @10:46PM (#35406640)
That's kind of the point. We solved this problem decades ago. You have a system package manager that installs a system-wide copy of the package that everybody can use.

But now we encounter this broken nonsense because solved problems get unsolved by bad software.