Re:Llama.cpp 30B runs with only 6GB of RAM now
by AnthonyMouse on Saturday April 01, 2023 @10:46PM
(#35406640)
That's kind of the point. We solved this problem decades ago. You have a system package manager that installs a system-wide copy of the package that everybody can use.
But now we encounter this broken nonsense because solved problems get unsolved by bad software.
But now we encounter this broken nonsense because solved problems get unsolved by bad software.