News for hackers. Stuff that matters.

A comment on Talk-Llama. Parent comment

Re:Talk-Llama by ForkMeOnTinder on Thursday November 02, 2023 @09:47AM (#38113458)
ollama is dead easy to use. It's a single binary that downloads models on demand, like docker downloads images.

  pacman -S ollama
  ollama serve
  ollama run llama2:13b 'insert prompt'
https://ollama.ai/
[ Parent | on HN ]
Re:Talk-Llama by riddleronroof on Thursday November 02, 2023 @10:06AM (#38113691)
ollama wraps llama.cpp into a docker container, correct? Besides that it seeks like a go server for chat?
[ Parent | on HN ]
Re:Talk-Llama by jsight on Thursday November 02, 2023 @10:56AM (#38114337)
The ollama shell is really nice.
[ Parent | on HN ]