News for hackers. Stuff that matters.

A comment on Llama.cpp guide – Running LLMs locally on any hardware, from scratch. Parent comment

Re:Llama.cpp guide – Running LLMs locally on any hardware, f... by elpocko on Friday November 29, 2024 @01:44PM (#42276009)
Privacy, freedom, huge selection of models, no censorship, higher flexibility, and it's free as in beer.
[ Parent | on HN ]
Re:Llama.cpp guide – Running LLMs locally on any hardware, f... by fzzzy on Friday November 29, 2024 @05:50PM (#42277831)
Ability to have a stable model version with stable weights until the end of time
[ Parent | on HN ]