News for hackers. Stuff that matters.
Re:Open-source project ZLUDA lets CUDA apps run on AMD GPUs by drakerossman on Tuesday March 05, 2024 @10:58AM (#39605205)
It now supports AMD GPUs since 3 weeks ago, check the latest commit at the repo:

https://github.com/vosen/ZLUDA

The article also mentions exactly this fact.

Re:Open-source project ZLUDA lets CUDA apps run on AMD GPUs by KeplerBoy on Tuesday March 05, 2024 @11:03AM (#39605300)
That's exactly what the post from 3 weeks ago discussed.

AMD dropped ZLUDA funding, the remains were opensourced and it won't ever be a viable option.

Re:Open-source project ZLUDA lets CUDA apps run on AMD GPUs by bri3d on Tuesday March 05, 2024 @11:20AM (#39605595)
> it won't ever be a viable option

For production workloads, I generally agree. It's an unsupported hack with a questionable future, I wouldn't do anything money-making with it.

However, for tinkering and consumer workloads, it already works pretty well. Enough of cuDNN and cuBLAS work to run PyTorch and in turn, Stable Diffusion with https://github.com/lshqqytiger/ZLUDA - there's even a fairly user-friendly setup process already in https://github.com/vladmandic/automatic .

I was able to get a personal non-ML related project working on my AMD card in just a few minutes, which saved me a lot of development time before I then deployed the production workload on NV hardware (this is probably why AMD pulled the plug on the project - it's almost more of a boost to NV than anything else, AMD really need people to be writing code on ROCm to deploy on AMD datacenter hardware).

Re:Open-source project ZLUDA lets CUDA apps run on AMD GPUs by HarHarVeryFunny on Tuesday March 05, 2024 @11:59AM (#39606182)
Given that PyTorch supports AMD cards with ROCm support, I'm curious why would you be coding in CUDA (very low level!) as opposed to PyTorch ?
Re:Open-source project ZLUDA lets CUDA apps run on AMD GPUs by bri3d on Tuesday March 05, 2024 @12:48PM (#39606826)
> a personal non-ML related project

Not everything is DNNs and tensors...

As for the Stable Diffusion thing, a silly edge case - because MIOpen (and therefore PyTorch-on-ROCm) doesn't work on Windows yet (they're slated to ship it next month, I think).

Re:Open-source project ZLUDA lets CUDA apps run on AMD GPUs by HarHarVeryFunny on Tuesday March 05, 2024 @02:01PM (#39607786)
> Not everything is DNNs and tensors...

Sure, but you could use PyTorch for cuBLAS/cuRAND etc type functionality too.