News for hackers. Stuff that matters.
Re:Ollama v0.1.45 by wmedrano on Saturday June 15, 2024 @10:24PM (#40694243)
Main reason I started using ollama is because it actually worked. I spent half an hour trying to get huggingface models to run on my GPU with no success. Meanwhile `sudo pacman -S ollama-rocm` seemed to just work out of the box.
Re:Ollama v0.1.45 by dheera on Sunday June 16, 2024 @12:10AM (#40694625)
Exactly, and as a bonus it runs an JSON API on localhost so you can call it from anything on your LAN, it's really, really amazing