News for hackers. Stuff that matters.

A comment on Llama.cpp guide – Running LLMs locally on any hardware, from scratch. Parent comment

Re:Llama.cpp guide – Running LLMs locally on any hardware, f... by SteelPh0enix on Friday November 29, 2024 @07:03PM (#42278272)
If you're satisfied with ollama, I don't think there's a point to go "lower" and use llama.cpp directly.

Unless you want to tinker.

[ Parent | on HN ]

There are no comments on this comment yet.