Run CUDA, unmodified, on AMD GPUs

Re:Run CUDA, unmodified, on AMD GPUs by yieldcrv on Monday July 15, 2024 @04:54PM (#40971377)

the real question here is whether anybody has gotten cheap, easily available AMD GPUs to run their AI workloads, and if we can predict more people will do so

[ Parent | on HN ]

Re:Run CUDA, unmodified, on AMD GPUs by anthonix1 on Monday July 15, 2024 @07:10PM (#40972289)

I ported Karparthy's llm.c repo to AMD devices [1], and have trained GPT2 from scratch with 10B tokens of fineweb-edu on a 4x 7900XTX machine in just a few hours (about $2 worth of electricity) [2].

I've also trained the larger GPT2-XL model from scratch on bigger CDNA machines.

Works fine.

[1] https://github.com/anthonix/llm.c [2] https://x.com/zealandic1

[ Parent | on HN ]

Re:Run CUDA, unmodified, on AMD GPUs by JonChesterfield on Monday July 15, 2024 @07:07PM (#40972271)

Microsoft have their production models running on amdgpu. I doubt it was easy but it's pretty compelling as an existence proof

[ Parent | on HN ]