News for hackers. Stuff that matters.

A comment on Show HN: Ollama for Linux – Run LLMs on Linux with GPU Acceleration.

Re:Show HN: Ollama for Linux – Run LLMs on Linux with GPU Ac... by ForkMeOnTinder on Tuesday September 26, 2023 @02:07PM (#37663423)
Huge fan of ollama. Although this is the first official linux release, I've been using it on linux already for a few months now with no issues (through the arch package which builds from source).

Getting started was literally as easy as:

  pacman -S ollama
  ollama serve
  ollama run llama2:13b 'insert prompt'
You guys are doing the lord's work here
[ Parent | on HN ]
Re:Show HN: Ollama for Linux – Run LLMs on Linux with GPU Ac... by factibicongue on Wednesday October 04, 2023 @12:34PM (#37767674)
"You guys are doing the lord's work here"?

How? By forcing users into a custom model serialization format (GGUF) that is claimed to literally contain "magic"?

Dark lord, maybe.

[ Parent | on HN ]