News for hackers. Stuff that matters.
Re:Llama.cpp 30B runs with only 6GB of RAM now by kmeisthax on Saturday April 01, 2023 @04:42PM (#35403868)
Yes, that's the "strategic" play I mentioned before.

This isn't really helpful for people who want open AI though, because if your strategy is to deny OpenAI data and knowledge then you aren't going to release any models either.

There are no comments on this comment yet.