Re:Llama.cpp 30B runs with only 6GB of RAM now
by kmeisthax on Saturday April 01, 2023 @04:42PM
(#35403868)
Yes, that's the "strategic" play I mentioned before.
This isn't really helpful for people who want open AI though, because if your strategy is to deny OpenAI data and knowledge then you aren't going to release any models either.
This isn't really helpful for people who want open AI though, because if your strategy is to deny OpenAI data and knowledge then you aren't going to release any models either.