Re:Making AMD GPUs competitive for LLM inference
by latchkey on Wednesday August 09, 2023 @07:39PM
(#37069884)
I've been waiting for someone to tell me what I can profitably do with the 120,000+ 470/480/580's that I have sitting around doing nothing. It sounds like you have an idea?
[ Parent
| on HN ]
Re:Making AMD GPUs competitive for LLM inference
by FirmwareBurner on Wednesday August 09, 2023 @08:42PM
(#37070371)
Crack passwords, also there was this craze a few years ago, where people were using their GPUS to crunch numbers and earn money, I forgot what it was called ... something with mines.
Re:Making AMD GPUs competitive for LLM inference
by latchkey on Wednesday August 09, 2023 @08:46PM
(#37070410)
Right... any legal ideas you have?
Re:Making AMD GPUs competitive for LLM inference
by FirmwareBurner on Wednesday August 09, 2023 @09:12PM
(#37070603)
Cracking passwords is legal if you obtained the hashes legally as part of your pentest conttract. So is shitcoin mining.
But you seem dead set that there are no uses for ROCm so I'll leave you there.
Re:Making AMD GPUs competitive for LLM inference
by latchkey on Wednesday August 09, 2023 @10:36PM
(#37071240)
If the best you can do is 'password cracking' as your answer, you're obviously not very well versed in things. Plus, you don't need ROCm to crack passwords.
Re:Making AMD GPUs competitive for LLM inference
by quickthrower2 on Wednesday August 09, 2023 @11:28PM
(#37071586)
Good luck trying to make enough money to pay for power let alone capex
Re:Making AMD GPUs competitive for LLM inference
by Arelius on Thursday August 10, 2023 @01:37AM
(#37072360)
I mean, I'm using ROCm for VFX rendering. But regardless i'm not sure that cards as old as your 470's can really be super competitive power usage wise to make them very profitable.
Re:Making AMD GPUs competitive for LLM inference
by latchkey on Thursday August 10, 2023 @10:27AM
(#37076587)
Correct, not profitable.
Re:Making AMD GPUs competitive for LLM inference
by Arelius on Thursday August 17, 2023 @11:51AM
(#37163559)
But just because you have old GPUs, doesn't imply there is a problem with ROCm. You'd have the same problem of economics with old Nvidia GPUs.
Re:Making AMD GPUs competitive for LLM inference
by latchkey on Thursday August 17, 2023 @12:13PM
(#37163946)
ROCm doesn't support old GPUs.
That said, people are finding hacks...
https://old.reddit.com/r/Amd/comments/15t0lsm/i_turned_a_95_...
Re:Making AMD GPUs competitive for LLM inference
by jrflowers on Thursday August 10, 2023 @02:33AM
(#37072653)
You could sell them or give them away to hobbyists, but that could eat into the lucrative “shoehorning old crypto mining into unrelated conversations” business
Re:Making AMD GPUs competitive for LLM inference
by FirmwareBurner on Thursday August 10, 2023 @07:11AM
(#37074588)
I was talking about hobbyists. Who said anything about businesses?