News for hackers. Stuff that matters.
Re:Llama.cpp 30B runs with only 6GB of RAM now by lannisterstark on Saturday April 01, 2023 @12:10AM (#35397029)
And THIS is why I always advocate for democratization of AI models, getting these into hands of open source community and letting people use it as they wish etc.

But a lot of people would rather only have govt or corp control of it...

There are no comments on this comment yet.