Re:Llama.cpp 30B runs with only 6GB of RAM now
by lannisterstark on Saturday April 01, 2023 @12:10AM
(#35397029)
And THIS is why I always advocate for democratization of AI models, getting these into hands of open source community and letting people use it as they wish etc.
But a lot of people would rather only have govt or corp control of it...
But a lot of people would rather only have govt or corp control of it...