Re:Llama.cpp 30B runs with only 6GB of RAM now
by terafo on Friday March 31, 2023 @05:06PM
(#35393655)
You mean in contained app? It can already run on a phone. GPU acceleration would be nice at this point, though.
[ Parent
| on HN ]