News for hackers. Stuff that matters.

A comment on Making AMD GPUs competitive for LLM inference. Parent comment

Re:Making AMD GPUs competitive for LLM inference by Arelius on Thursday August 10, 2023 @01:37AM (#37072360)
I mean, I'm using ROCm for VFX rendering. But regardless i'm not sure that cards as old as your 470's can really be super competitive power usage wise to make them very profitable.
[ Parent | on HN ]
Re:Making AMD GPUs competitive for LLM inference by latchkey on Thursday August 10, 2023 @10:27AM (#37076587)
Correct, not profitable.
[ Parent | on HN ]
Re:Making AMD GPUs competitive for LLM inference by Arelius on Thursday August 17, 2023 @11:51AM (#37163559)
But just because you have old GPUs, doesn't imply there is a problem with ROCm. You'd have the same problem of economics with old Nvidia GPUs.
[ Parent | on HN ]
Re:Making AMD GPUs competitive for LLM inference by latchkey on Thursday August 17, 2023 @12:13PM (#37163946)
ROCm doesn't support old GPUs.

That said, people are finding hacks...

https://old.reddit.com/r/Amd/comments/15t0lsm/i_turned_a_95_...

[ Parent | on HN ]