Llama.cpp guide – Running LLMs locally on any hardware, from scratch

Re:Llama.cpp guide – Running LLMs locally on any hardware, f... by SteelPh0enix on Saturday November 30, 2024 @02:31AM (#42280159)

I use llama.cpp mostly for working with code that i can't share with any online provider. Simple NDA stuff. Some refactors are easier to do via LLM than manually. It's a decent debugging duck too.

[ Parent | on HN ]

Re:Llama.cpp guide – Running LLMs locally on any hardware, f... by varispeed on Saturday November 30, 2024 @09:49AM (#42281912)

Do you know any tutorial that could help me set something like this up?

[ Parent | on HN ]