Re:Llama.cpp 30B runs with only 6GB of RAM now
by Accujack on Saturday April 01, 2023 @10:35PM
(#35406562)
This is not exactly a new problem.
[ Parent
| on HN ]
Re:Llama.cpp 30B runs with only 6GB of RAM now
by AnthonyMouse on Saturday April 01, 2023 @10:46PM
(#35406640)
That's kind of the point. We solved this problem decades ago. You have a system package manager that installs a system-wide copy of the package that everybody can use.
But now we encounter this broken nonsense because solved problems get unsolved by bad software.