News for hackers. Stuff that matters.
Re:Llama.cpp 30B runs with only 6GB of RAM now by JBorrow on Saturday April 01, 2023 @09:36AM (#35400202)
$n00k of compute time is nothing, sorry. This is the kind of thing that academic institutions can give out for free…
Re:Llama.cpp 30B runs with only 6GB of RAM now by linesinthesand on Saturday April 01, 2023 @09:46AM (#35400271)
why don't you write the check then huh
Re:Llama.cpp 30B runs with only 6GB of RAM now by jart on Saturday April 01, 2023 @10:40PM (#35406593)
* * *