News for hackers. Stuff that matters.

A comment on Show HN: Ollama for Linux – Run LLMs on Linux with GPU Acceleration. Parent comment

Re:Show HN: Ollama for Linux – Run LLMs on Linux with GPU Ac... by brucethemoose2 on Tuesday September 26, 2023 @02:27PM (#37663721)
This one is basically SOTA for AMD, if you can install rocm properly:

https://github.com/YellowRoseCx/koboldcpp-rocm

Some other projects support rocm less explicitly, and not as easily.

[ Parent | on HN ]

There are no comments on this comment yet.