News for hackers. Stuff that matters.

A comment on Show HN: LlamaGPT – Self-hosted, offline, private AI chatbot, powered by Llama 2.

Re:Show HN: LlamaGPT – Self-hosted, offline, private AI chat... by synaesthesisx on Wednesday August 16, 2023 @06:04PM (#37154494)
How this compare to just running llama.cpp locally?
[ Parent | on HN ]
Re:Show HN: LlamaGPT – Self-hosted, offline, private AI chat... by mayankchhabra on Wednesday August 16, 2023 @06:08PM (#37154530)
It's an entire app (with a chatbot UI) that takes away the technical legwork to run the model locally. It's a simple one line `docker compose up -d` on any machine, or one click install on umbrelOS home servers.
[ Parent | on HN ]