News for hackers. Stuff that matters.
Re:Llama.cpp 30B runs with only 6GB of RAM now by terafo on Friday March 31, 2023 @05:19PM (#35393813)
Wish you all luck in the world. We need much more clarity in legal status of these models.
Re:Llama.cpp 30B runs with only 6GB of RAM now by sillysaurusx on Friday March 31, 2023 @05:20PM (#35393827)
Thanks! HN is pretty magical. I think they saw https://news.ycombinator.com/item?id=35288534 and decided to fund it.

I’m grateful for the opportunity to help protect open source projects such as this one. It will at least give Huggingface a basis to resist DMCAs in the short term.