News for hackers. Stuff that matters.

A comment on Making AMD GPUs competitive for LLM inference. Parent comment

Re:Making AMD GPUs competitive for LLM inference by kstenerud on Wednesday August 09, 2023 @10:58PM (#37071410)
Are there any docker images containing this? I'd like to avoid getting into dependency hell with other software on my system, as happens all too often with new technologies.
[ Parent | on HN ]
Re:Making AMD GPUs competitive for LLM inference by scrps on Thursday August 10, 2023 @12:52AM (#37072104)
There are thankfully, quite a few, ive mostly used rocm/rocm-terminal and rocm/rocm-dev.

https://hub.docker.com/u/rocm

[ Parent | on HN ]