Re:Llama.cpp 30B runs with only 6GB of RAM now
by mx20 on Saturday April 01, 2023 @05:19AM
(#35398659)
Maybe a lot of people/companies also don't want to give their data and knowledge to OpenAI, so that they can sell it off to the competition.
[ Parent
| on HN ]
Re:Llama.cpp 30B runs with only 6GB of RAM now
by kmeisthax on Saturday April 01, 2023 @04:42PM
(#35403868)
Yes, that's the "strategic" play I mentioned before.
This isn't really helpful for people who want open AI though, because if your strategy is to deny OpenAI data and knowledge then you aren't going to release any models either.