Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on What's new in Llama 2 and how to run it locally. Parent comment
On Linux, ExLlama and MLC LLM have native ROCm support, and there is a HIPified fork of llama.cpp as well.
There are no comments on this comment yet.
On Linux, ExLlama and MLC LLM have native ROCm support, and there is a HIPified fork of llama.cpp as well.