News for hackers. Stuff that matters.
Re:AMD's AI Future Is Rack Scale 'Helios' by hyperbovine on Sunday June 15, 2025 @07:45AM (#44281820)
I'm willing to bet almost nobody you know calls the CUDA API directly. What AMD needs to focus on is getting the ROCm backend going for XLA and PyTorch. That would unlock a big slice of the market right there.

They should also be dropping free AMD GPUs off helicopters, as Nvidia did a decade or so ago, in order to build up an academic userbase. Academia is getting totally squeezed by industry when it comes to AI compute. We're mostly running on hardware that's 2 or 3 generations out of date. If AMD came with a well supported GPU that cost half what an A100 sells for, voila you'd have cohort after cohort of grad students training models on AMD and then taking that know-how into industry.

Re:AMD's AI Future Is Rack Scale 'Helios' by bwfan123 on Sunday June 15, 2025 @10:54AM (#44282595)
Indeed. the user-facing software stack componentry - pytorch and jax/xla - are owned by meta, and google and open sourced. Further, the open-source models (llama/deepseek) are largely hw agnostic. There is really no user or eco-system lock-in. Also, clouds are highly incentivized to have multiple hardware alternatives.
Re:AMD's AI Future Is Rack Scale 'Helios' by pjmlp on Sunday June 15, 2025 @12:42PM (#44283276)
HN keeps forgetting game development and VFX exists.
Re:AMD's AI Future Is Rack Scale 'Helios' by hyperbovine on Sunday June 15, 2025 @01:06PM (#44283452)
What fraction of Nvidia revenue comes from those applications?
Re:AMD's AI Future Is Rack Scale 'Helios' by pjmlp on Sunday June 15, 2025 @04:04PM (#44284633)
Lets put it this way, they need graphics cards, and CUDA is now relatively common.

For example OTOY OctaneRender, one of the key renders in Hollywood.

Re:AMD's AI Future Is Rack Scale 'Helios' by akshayt on Monday June 16, 2025 @02:46AM (#44287169)
About 0.1% from professional visualization in Q1 this year
Re:AMD's AI Future Is Rack Scale 'Helios' by aseipp on Sunday June 15, 2025 @02:49PM (#44284201)
There already is ROCm support for PyTorch. Then there's stuff like this: https://semianalysis.com/2024/12/22/mi300x-vs-h100-vs-h200-b...

They have improved since that article, by a decent amount from my understanding. But by now, it isn't enough to have "a backend". The historical efforts have spoiled that narrative so badly that it won't be enough to just have a pytorch-rocm pypi package; some of that flak is unfair though not completely unsubstantiated. But frankly they need to deliver better software, across all their offerings, for multiple successive generations before the bad optics around their software stack will start fading. Their competitors are already on their next gen architecture since that article was written.

You are correct that people don't really invoke CUDA APIs much, but that's partially because those APIs actually work and deliver good performance, so things can actually be built on top of them.

Re:AMD's AI Future Is Rack Scale 'Helios' by 7speter on Tuesday June 17, 2025 @12:11AM (#44295689)
AMD isn’t doing what you’re proposing, but it seems intel is a few months out from this.