News for hackers. Stuff that matters.

A comment on Llama.cpp 30B runs with only 6GB of RAM now. Parent comment

Re:Llama.cpp 30B runs with only 6GB of RAM now by revelio on Saturday April 01, 2023 @10:50AM (#35400733)
There's a Java ML library called Tribuo that might be worth looking at.
[ Parent | on HN ]
Re:Llama.cpp 30B runs with only 6GB of RAM now by dopidopHN on Saturday April 01, 2023 @11:06AM (#35400868)
Thanks, the boring aspect of Java is appealing here.
[ Parent | on HN ]