News for hackers. Stuff that matters.
Re:I want everything local – Building my offline AI workspace by akawry on Sunday August 10, 2025 @09:23AM (#44855027)
Take a look at ik_llama.cpp: https://github.com/ikawrakow/ik_llama.cpp

CPU performance is much better than mainline llama, as well as having more quantization types available

There are no comments on this comment yet.