News for hackers. Stuff that matters.
Re:AMD's AI Future Is Rack Scale 'Helios' by stingraycharles on Sunday June 15, 2025 @12:39AM (#44280569)
Yes but then they fail to understand a lot of “long tail” home projects, opensource stuff etc is done on consumer GPUs at home, which is tremendously important for ecosystem support.
Re:AMD's AI Future Is Rack Scale 'Helios' by wmf on Sunday June 15, 2025 @01:08AM (#44280684)
What if they understand that and they don't care? Getting one hyperscaler as a customer is worth more than the entire long tail.
Re:AMD's AI Future Is Rack Scale 'Helios' by stingraycharles on Sunday June 15, 2025 @01:51AM (#44280810)
The problem is that this is short-term thinking. You need students and professionals playing around with your tools at home and/or on their work computers to drive hyperscale demand in the long term.

This is why it’s so important AMD gets their act together quickly, as the benefits of these kind of things are measured in years, not months.

Re:AMD's AI Future Is Rack Scale 'Helios' by selectodude on Sunday June 15, 2025 @01:18AM (#44280711)
Then they’re fools. Every AI maestro knows CUDA because they learned it at home.
Re:AMD's AI Future Is Rack Scale 'Helios' by jiggawatts on Sunday June 15, 2025 @01:54AM (#44280816)
It’s the same reason there’s orders of magnitude more code written for Linux than for mainframes.
Re:AMD's AI Future Is Rack Scale 'Helios' by danielheath on Sunday June 15, 2025 @02:55AM (#44280976)
Why would a hyperscaler pick the technology that’s harder to hire for (because there’s no hobbyist-to-expert pipeline)?
Re:AMD's AI Future Is Rack Scale 'Helios' by moffkalast on Sunday June 15, 2025 @03:33AM (#44281103)
Then they will stay irrelevant in the GPU space like they have been so far.
Re:AMD's AI Future Is Rack Scale 'Helios' by lhl on Sunday June 15, 2025 @04:19AM (#44281211)
On the corp side you have FB w/ PyTorch, xformers (still pretty iffy on AMD support tbt) and MS w/ DeepSpeed. But let's see about some others:

Flash Attention: academia, 2y behind for AMD support

bitsandbytes: academia, 2y behind for AMD support

Marlin: academia, no AMD support

FlashInfer: acadedmia/startup, no AMD

ThunderKittens: academia, no AMD support

DeepGEMM, DeepEP, FlashMLA: ofc, nothing from China supports AMD

Without the long tail AMD will continue to always be in a position where they have to scramble to try to add second tier support years later themselves, while Nvidia continues to get all the latest and greatest for free.

This is just off the top of my head on the LLM side where I'm focused on, btw. Whenever I look at image/video it's even more grim.

Re:AMD's AI Future Is Rack Scale 'Helios' by jimmySixDOF on Sunday June 15, 2025 @04:33AM (#44281247)
Modular says Max/Mojo will change this and make refactoring between different vendors (and different lines of the same vendor) less of a showstopper but tbd for now
Re:AMD's AI Future Is Rack Scale 'Helios' by pjmlp on Sunday June 15, 2025 @12:45PM (#44283308)
The judge is still out there regarding if Max/Mojo is going to be something that the large majority cares about.
Re:AMD's AI Future Is Rack Scale 'Helios' by littlestymaar on Sunday June 15, 2025 @04:36AM (#44281257)
Why should we care about them if they don't care?

I mean of they want to stay at a fraction of the market value and profit of their direct competitor, good for them.

Re:AMD's AI Future Is Rack Scale 'Helios' by dummydummy1234 on Sunday June 15, 2025 @07:47AM (#44281830)
I want a competitive market so I can have cheaper gpus.

It's Nvidia, AMD, and maybe Intel.

Re:AMD's AI Future Is Rack Scale 'Helios' by cma on Sunday June 15, 2025 @12:47AM (#44280604)
Nvidia started removing nvlink with the 4000 series, they aren't heavily focused on it either anymore and want to sell the workstation cards for uses like training models at home.
Re:AMD's AI Future Is Rack Scale 'Helios' by 7speter on Tuesday June 17, 2025 @12:17AM (#44295718)
As a beginner, you can get a lot done on a 4060ti/5060ti 16gb, much less a 4090/5090.

Heck I’ve been able to work through the early chapters of the FastAI book using a lowly Quadro p1000