News for hackers. Stuff that matters.
Re:Intel’s Arc GPUs will compete with GeForce and Radeon in ... by byefruit on Monday August 16, 2021 @12:51PM (#28200173)
I really hope this breaks Nvidia's stranglehold on deep learning. Some competition would hopefully bring down prices at the compute high-end.

AMD don't seem to even be trying on the software-side at the moment. ROCm is a mess.

Re:Intel’s Arc GPUs will compete with GeForce and Radeon in ... by pjmlp on Monday August 16, 2021 @04:25PM (#28202501)
You know how to break it?

With modern tooling.

Instead of forcing devs to live in the pre-historic days of C dialects and printf debugging, provide polyglot IDEs with graphical debugging tools capable of single step GPU shaders and a rich libraries ecosystem.

Khronos got the message too late and now no one cares.

Re:Intel’s Arc GPUs will compete with GeForce and Radeon in ... by rowanG077 on Monday August 16, 2021 @01:07PM (#28200357)
I think this situation can only be fixed by moving up into languages that compile to vendor specific GPU languages. Just treat CUDA, openCL, vulkan compute, metal compute(??) etc. as the assembly of graphics cards.
Re:Intel’s Arc GPUs will compete with GeForce and Radeon in ... by pjmlp on Monday August 16, 2021 @04:32PM (#28202578)
That is just part of the story.

CUDA wiped out OpenCL, because it went polyglot as of version 3.0, while insisting that everyone should write in a C dialect.

They also provide great graphical debugging tools and libraries.

Khronos waited too long to introduce SPIR, and in traditional Khronos fashion, waited for the partners to provide the tooling.

One could blame NVidia, but it isn't as the competition has done a better job.

Re:Intel’s Arc GPUs will compete with GeForce and Radeon in ... by hobofan on Monday August 16, 2021 @02:09PM (#28201022)
Barely anyone is writing CUDA directly these days. Just add support in PyTorch and Tensorflow and you've covered probably 90% of the deep learning market.
Re:Intel’s Arc GPUs will compete with GeForce and Radeon in ... by hprotagonist on Monday August 16, 2021 @02:18PM (#28201114)
and ONNX.
Re:Intel’s Arc GPUs will compete with GeForce and Radeon in ... by T-A on Monday August 16, 2021 @01:15PM (#28200469)
Re:Intel’s Arc GPUs will compete with GeForce and Radeon in ... by snicker7 on Monday August 16, 2021 @02:51PM (#28201486)
Currently only supported by Intel.
Re:Intel’s Arc GPUs will compete with GeForce and Radeon in ... by T-A on Wednesday August 18, 2021 @07:46PM (#28228666)
Re:Intel’s Arc GPUs will compete with GeForce and Radeon in ... by jjcon on Monday August 16, 2021 @12:58PM (#28200261)
I wholeheartedly agree. PyTorch did recently release AMD support which I was happy to see (though I have not tested it), I’m hoping there is more to come.

https://pytorch.org/blog/pytorch-for-amd-rocm-platform-now-a...

Re:Intel’s Arc GPUs will compete with GeForce and Radeon in ... by byefruit on Monday August 16, 2021 @01:16PM (#28200477)
Unfortunately that support is via ROCm, which doesn't support the last three generations (!) of AMD hardware: https://github.com/ROCm/ROCm.github.io/blob/master/hardware....
Re:Intel’s Arc GPUs will compete with GeForce and Radeon in ... by dragontamer on Monday August 16, 2021 @01:21PM (#28200539)
ROCm supports Vega, Vega 7nm, and CDNA just fine.

The issue is that AMD has split their compute into two categories:

* RDNA -- consumer cards. A new ISA with new compilers / everything. I don't think its reasonable to expect AMD's compilers to work on RDNA, when such large changes have been made to the architecture. (32-wide instead of 64-wide. 1024 registers. Etc. etc.)

* CDNA -- based off of Vega's ISA. Despite being "legacy ISA", its pretty modern in terms of capabilities. MI100 is competitive against the A100. CDNA is likely going to run Frontier and El Capitan supercomputers.

------------

ROCm focused on CDNA. They've had compilers emit RDNA code, but its not "official" and still buggy. But if you went for CDNA, that HIP / ROCm stuff works enough for the Oak Ridge National Labs.

Yeah, CDNA is expensive ($5k for MI50 / Radeon VII, and $9k for MI100). But that's the price of full-speed scientific-oriented double-precision floating point GPUs these days.

Re:Intel’s Arc GPUs will compete with GeForce and Radeon in ... by paulmd on Monday August 16, 2021 @02:24PM (#28201180)
> ROCm supports Vega, Vega 7nm, and CDNA just fine.

yeah, but that's exactly what OP said - Vega is three generations old at this point, and that is the last consumer GPU (apart from VII which is a rebranded compute card) that ROCm supports.

On the NVIDIA side, you can run at least basic tensorflow/pytorch/etc on a consumer GPU, and that option is not available on the AMD side, you have to spend $5k to get a GPU that their software actually supports.

Not only that but on the AMD side it's a completely standalone compute card - none of the supported compute cards do graphics anymore. Whereas if you buy a 3090 at least you can game on it too.

Re:Intel’s Arc GPUs will compete with GeForce and Radeon in ... by Tostino on Monday August 16, 2021 @03:10PM (#28201668)
I really don't think people appreciate the fact enough that for developers to care to learn about building software for your platform, you need to make it accessible for them to run that software. That means "run on the hardware they will already have". AMD really need to push to get ROCm compiling for RDNA based chips.
Re:Intel’s Arc GPUs will compete with GeForce and Radeon in ... by paulmd on Thursday August 26, 2021 @07:09PM (#28322184)
yeah, it's hard to overstate the importance of getting your hardware into people's hands to work with. A $5k buy-in before you can even play with programming on a device and figure out if your program is going to work on GPGPU at all is a big deal! CUDA being accessible on a $100 gaming GPU has enabled a lot of development, and NVIDIA also has made big efforts to get their hardware out to universities, and that has paid big dividends as well.

Also, just flat-out using your own developers to write the basic code for libraries and frameworks and so on. There are tons of basic libraries like CuRAND and CUB (Cuda UnBound) and I'm sure tons of others that NVIDIA wrote not because a customer wanted that, but because it was building blocks that others could leverage into products that would sell NVIDIA hardware. In contrast AMD has fallen behind in that area, and has further fragmented their development work across a bunch of "flavor of the week" frameworks and implementations that usually get discarded within a couple years (remember HIP? remember Bolt? etc)

Re:Intel’s Arc GPUs will compete with GeForce and Radeon in ... by slavik81 on Monday August 16, 2021 @03:14PM (#28201714)
There's unofficial support in the rocm-4.3.0 math-libs for gfx1030 (6800 / 6800 XT / 6900 XT). rocBLAS also includes gfx1010, gfx1011 and gfx1012 (5000 series). If you encounter any bugs in the {roc,hip}{BLAS,SPARSE,SOLVER,FFT} stack with those cards, file GitHub issues on the corresponding project.

I have not seen any problems with those cards in BLAS or SOLVER, though they don't get tested as much as the officially supported cards.

FWIW, I finally managed to buy an RX 6800 XT for my personal rig. I'll be following up on any issues found in the dense linear algebra stack on that card.

I work for AMD on ROCm, but all opinions are my own.

Re:Intel’s Arc GPUs will compete with GeForce and Radeon in ... by BadInformatics on Monday August 16, 2021 @05:24PM (#28203183)
I've mentioned this on other forums, but it would help to have some kind of easily visible, public tracker for this progress. Even a text file, set of GitHub issues or project board would do.

Why? Because as-is, most people still believe support for gfx1000 cards is non-existent in any ROCm library. Of course that's not the case as you've pointed out here, but without any good sign of forward progress, your average user is going to assume close to zero support. Vague comments like https://github.com/RadeonOpenCompute/ROCm/issues/1542 are better than nothing, but don't inspire that much confidence without some more detail.

Re:Intel’s Arc GPUs will compete with GeForce and Radeon in ... by FeepingCreature on Monday August 16, 2021 @02:43PM (#28201387)
You don't think it's reasonable to expect machine learning to work on new cards?

That's exactly the point. ML on AMD is a third-class citizen.

Re:Intel’s Arc GPUs will compete with GeForce and Radeon in ... by dragontamer on Monday August 16, 2021 @02:45PM (#28201411)
AMD's MI100 has those 4x4 BFloat16 and FP16 matrix multiplication instructions you want, with PyTorch and TensorFlow compiling down into them through ROCm.

Now don't get me wrong: $9000 is a lot for a development system to try out the software. NVidia's advantage is that you can test out the A100 by writing software for cheaper GeForce cards at first.

NVidia also makes it easy with the DGX computer to quickly get a big A100-based computer. AMD you gotta shop around with Dell vs Supermicro (etc. etc.) to find someone to build you that computer.

Re:Intel’s Arc GPUs will compete with GeForce and Radeon in ... by byefruit on Monday August 16, 2021 @01:44PM (#28200768)
That makes a lot more sense, thanks. They could do with making that a lot clearer on the project.

Still handicaps them compared to Nvidia where you can just buy anything recent and expect it to work. Suspect it also means they get virtually no open source contributions from the community because nobody can run or test it on personal hardware.

Re:Intel’s Arc GPUs will compete with GeForce and Radeon in ... by dragontamer on Monday August 16, 2021 @01:49PM (#28200823)
NVidia can support anything because they have a PTX-translation layer between cards, and invest heavily on PTX.

Each assembly language from each generation of cards changes. PTX recompiles the "pseudo-assembly" instructions into the new assembly code each generation.

---------

AMD has no such technology. When AMD's assembly language changes (ex: from Vega into RDNA), its a big compiler change. AMD managed to keep the ISA mostly compatible from 7xxx GCN 1.0 series in the late 00s all the way to Vega 7nm in the late 10s... but RDNA's ISA change was pretty massive.

I think its only natural that RDNA was going to have compiler issues.

---------

AMD focused on Vulkan / DirectX support for its RDNA cards, while its compute team focused on continuing "CDNA" (which won large supercomputer contracts). So that's just how the business ended up.

Re:Intel’s Arc GPUs will compete with GeForce and Radeon in ... by blagie on Monday August 16, 2021 @02:21PM (#28201144)
I bought an ATI card for deep learning. I'm a big fan of open source. Less than 12 months later, ROCm dropped support. I bought an NVidia, and I'm not looking back.

This makes absolutely no sense to me, and I have a Ph.D:

"* RDNA -- consumer cards. A new ISA with new compilers / everything. I don't think its reasonable to expect AMD's compilers to work on RDNA, when such large changes have been made to the architecture. (32-wide instead of 64-wide. 1024 registers. Etc. etc.) * CDNA -- based off of Vega's ISA. Despite being "legacy ISA", its pretty modern in terms of capabilities. MI100 is competitive against the A100. CDNA is likely going to run Frontier and El Capitan supercomputers. ROCm focused on CDNA. They've had compilers emit RDNA code, but its not "official" and still buggy. But if you went for CDNA, that HIP / ROCm stuff works enough for the Oak Ridge National Labs. Yeah, CDNA is expensive ($5k for MI50 / Radeon VII, and $9k for MI100). But that's the price of full-speed scientific-oriented double-precision floating point GPUs these days.

I neither know nor care what RDNA, CDNA, A100, MI50, Radeon VII, MI100, or all the other AMD acronyms are. Yes, I could figure it out, but I want plug-and-play, stability, and backwards-compatibility. I ran into a whole different minefield with AMD. I'd need to run old ROCm, downgrade my kernel, and use a different card to drive monitors than for ROCm. It was a mess.

NVidia gave me plug-and-play. I bought a random NVidia card with the highest "compute level," and was confident everything would work. It does. I'm happy.

Intel has historically had great open source drivers, and if it give better plug-and-play and open source, I'll buy Intel next time. I'm skeptical, though. The past few year, Intel has a hard time tying their own shoelaces. I can't imagine this will be different.

Re:Intel’s Arc GPUs will compete with GeForce and Radeon in ... by dragontamer on Monday August 16, 2021 @02:28PM (#28201225)
> Yes, I could figure it out, but I want plug-and-play, stability, and backwards-compatibility

Its right there in the ROCm introduction.

https://github.com/RadeonOpenCompute/ROCm#Hardware-and-Softw...

> ROCm officially supports AMD GPUs that use following chips:

> GFX9 GPUs

> "Vega 10" chips, such as on the AMD Radeon RX Vega 64 and Radeon Instinct MI25

> "Vega 7nm" chips, such as on the Radeon Instinct MI50, Radeon Instinct MI60 or AMD Radeon VII, Radeon Pro VII

> CDNA GPUs

> MI100 chips such as on the AMD Instinct™ MI100

--------

The documentation of ROCm is pretty clear that it works on a limited range of hardware, with "unofficial" support at best on other sets of hardware.

Re:Intel’s Arc GPUs will compete with GeForce and Radeon in ... by blagie on Monday August 16, 2021 @03:41PM (#28201985)
Only...

(1) There are a million different ROCm pages and introductions

(2) Even that page is out-of-date, and e.g. claims unofficial support for "GFX8 GPUs: Polaris 11 chips, such as on the AMD Radeon RX 570 and Radeon Pro WX 4100," although those were randomly disabled after ROCm 3.5.1.

... if you have a Ph.D in AMD productology, you might be able to figure it out. If it's merely in computer science, math, or engineering, you're SOL.

There are now unofficial guides to downgrading to 3.5.1, only 3.5.1 doesn't work with many modern frameworks, and you land in a version incompatibility mess.

These aren't old cards either.

Half-decent engineer time is worth $350/hour, all in (benefits, overhead, etc.). Once you've spent a week futzing with AMD's mess, you're behind by the cost of ten NVidia A4000 cards which Just Work.

As a footnote, I suspect in the long term, small purchases will be worth more than the supercomputing megacontracts. GPGPU is wildly underutilized right now. That's mostly a gap of software, standards, and support. If we can get that right, every computer have many teraflops of computing power, even for stupid video chat filters and whatnot.

Re:Intel’s Arc GPUs will compete with GeForce and Radeon in ... by dragontamer on Monday August 16, 2021 @03:58PM (#28202168)
> Half-decent engineer time is worth $350/hour, all in (benefits, overhead, etc.). Once you've spent a week futzing with AMD's mess, you're behind by the cost of ten NVidia A4000 cards which Just Work.

It seems pretty simple to me if we're talking about compute. The MI-cards are AMD's line of compute GPUs. Buy an MI-card if you want to use ROCm with full support. That's MI25, MI50, or MI100.

> As a footnote, I suspect in the long term, small purchases will be worth more than the supercomputing megacontracts. GPGPU is wildly underutilized right now. That's mostly a gap of software, standards, and support. If we can get that right, every computer have many teraflops of computing power, even for stupid video chat filters and whatnot.

I think you're right, but the #1 use of these devices is running video games (aka: DirectX and Vulkan). Compute capabilities are quite secondary at the moment.

Re:Intel’s Arc GPUs will compete with GeForce and Radeon in ... by blagie on Tuesday August 17, 2021 @07:11AM (#28208582)
> It seems pretty simple to me if we're talking about compute. The MI-cards are AMD's line of compute GPUs. Buy an MI-card if you want to use ROCm with full support. That's MI25, MI50, or MI100.

For tasks which require that much GPU, I'm using cloud machines. My dev desktop would like a working GPU 24/7, but it doesn't need to be nearly that big.

If I had my druthers, I would have bought an NVidia 3050, since it has adequate compute, and will run once available <$300. Of course, anything from the NVidia consumer line is impossible to buy right now, except at scalper prices.

I just did a web search. The only card from that series I can find for sale, new, was the MI100, which runs $13k. The MI50 doesn't exist, and the MI25 can only be bought used on eBay. Corporate won't do eBay. Even the MI100 would require an exception, since it's an unauthorized vendor (Amazon doesn't have it).

Combine that with poor software support, and an unknown EOL, and it's a pretty bad deal.

> I think you're right, but the #1 use of these devices is running video games (aka: DirectX and Vulkan). Compute capabilities are quite secondary at the moment.

Companies should maximize shareholder value. Right now:

- NVidia is building an insurmountable moat. I already bought an NVidia card, and our software already has CUDA dependencies. I started with ROCm. I dropped it. I'm building developer tools, and if they pick up, they'll carry a lot of people.

- It will be years before I'm interested in trying ROCm again. I was oversold, and AMD underdelivered.

- Broad adoption is limited by lack of standards and mature software.

It's fine to day compute capabilities are secondary right now, but I think that will limit AMD in the long term. And I think lack of standards is to NVidia's advantage right now, but it will hinder long-term adoption.

If I were NVidia, I'd make:

- A reference CUDA open-source implementation which makes CUDA coda 100% compatible with Xe and Radeon

- License it under GPL with a CLA, so any Intel and AMD enhancements are open and flow back

- Have nominal optimizations in the open-source reference implementation, while keeping the high-performance proprietary optimizations NVidia proprietary (and only for NVidia GPUs)

This would encourage broad adoption of GPGPU, since any code I wrote would work on any customer machine, Intel, AMD, or NVidia. On the other hand, it would create an unlevel playing field for NVidia, since as the copyright holder, only NVidia could have proprietary optimizations. HPC would go to NVidia, as would markets like video editing or CAD.

Re:Intel’s Arc GPUs will compete with GeForce and Radeon in ... by wmf on Monday August 16, 2021 @02:11PM (#28201048)
Hopefully CDNA2 will be similar enough to RDNA2/3 that the same software stack will work with both.
Re:Intel’s Arc GPUs will compete with GeForce and Radeon in ... by dragontamer on Monday August 16, 2021 @02:13PM (#28201067)
I assume the opposite is going on.

Hopefully the RDNA3 software stack is good enough that AMD decides that CDNA2 (or CDNA-3) can be based off of the RDNA-instruction set.

AMD doesn't want to piss off its $100 million+ customers with a crappy software stack.

---------

BTW: AMD is reporting that parts of ROCm 4.3 are working with the 6900 XT GPU (suggesting that RDNA code generation is beginning to work). I know that ROCm 4.0+ has made a lot of github checkins that suggest that AMD is now actively working on the RDNA-code generation. Its not officially written into the ROCm documentation yet, its mostly the discussions with ROCm github issues that are noting these changes.

Its not official support and its literally years late. But its clear what AMD's current strategy is.

Re:Intel’s Arc GPUs will compete with GeForce and Radeon in ... by lvl100 on Monday August 16, 2021 @01:42PM (#28200738)
I agree 100% and if Nvidia’s recent showing and puzzling focus on “Omniverse” is any indication, they’re operating in a fantasy world a bit.
Re:Intel’s Arc GPUs will compete with GeForce and Radeon in ... by rektide on Monday August 16, 2021 @01:20PM (#28200523)
ROCm seems to be tolerably decent, if you are willing to spend a couple hours, and, big if, if HIP supports all the various libraries you were relying on. CUDA has a huge support library, and ROCm has been missing not just the small fry stuff but a lot of the core stuff in the that library.

Long term, AI (& a lot of other interests) need to serve themselves. CUDA is excellently convenient, but long term I have a hard time imagining there being a worthwhile future for anything but Vulkan. There don't seem to be a lot of forays into writing good all-encompassing libraries in Vulkan yet, nor many more specialized AI/ML Vulkan libraries, so it feels largely like we more or less haven't started really trying.

Re:Intel’s Arc GPUs will compete with GeForce and Radeon in ... by dnautics on Monday August 16, 2021 @01:22PM (#28200548)
is there any indication that ROCm has solved its stability issues? I wasn't doing the testing myself, but the reason why we rejected ROCm a while back (2 years?) was because you could get segfaults hours into a ML training run, which is... frustrating, to say the least, and not easily identifiable in quickie test runs (or CI, if ML did more CI).
Re:Intel’s Arc GPUs will compete with GeForce and Radeon in ... by rektide on Monday August 16, 2021 @03:51PM (#28202083)
Lot of downvotes. Anyone have any opinion? Is CUDA fine forever? Is there something other than Vulkan we should also try? Do you think AMD should solve every problem CUDA solves for their customers too? What gives here?

I see a lot a lot a lot of resistance to the idea that we should start trying to align to Vulkan. Here & elsewhere. I don't get it, it makes no sense, & everyone else using GPU's is running fast as they can towards Vulkan. Is it just too soon too early in the adoption curve, or do ya'll think there are more serious obstructions long term to building a more Vulkan centric AI/ML toolkit? It still feels inevitable to me. What we are doing now feels like a waste of time. I wish ya'll wouldn't downvote so casually, wouldn't just try to brush this viewpoint away.

Re:Intel’s Arc GPUs will compete with GeForce and Radeon in ... by BadInformatics on Monday August 16, 2021 @05:50PM (#28203391)
> Do you think AMD should solve every problem CUDA solves for their customers too?

They had no choice. Getting a bunch of HPC people to completely rewrite their code for a different API is a tough pill to swallow when you're trying to win supercomputer contracts. Would they have preferred to spend development resources elsewhere? Probably, they've even got their own standards and SDKs from days past.

> everyone else using GPU's is running fast as they can towards Vulkan

I'm not qualified to comment on the entirety of it, but I can say that basically no claim in this statement is true:

1. Not everyone doing compute is using GPUs. Companies are increasingly designing and releasing their own custom hardware (TPUs, IPUs, NPUs, etc.)

2. Not everyone using GPUs is cares about Vulkan. Certainly many folks doing graphics stuff don't, and DirectX is as healthy as ever. There have been bits and pieces of work around Vulkan compute for mobile ML model deployment, but it's a tiny niche and doesn't involve discrete GPUs at all.

> Is it just too soon too early in the adoption curve

Yes. Vulkan compute is still missing many of the niceties of more developed compute APIs. Tooling is one big part of that: writing shaders using GLSL is a pretty big step down from using whatever language you were using before (C++, Fortran, Python, etc).

> do ya'll think there are more serious obstructions long term to building a more Vulkan centric AI/ML toolkit

You could probably write a whole page about this, but TL;DR yes. It would take at least as much effort as AMD and Intel put into their respective compute stacks to get Vulkan ML anywhere near ready for prime time. You need to have inference, training, cross-device communication, headless GPU usage, reasonably wide compatibility, not garbage performance, framework integration, passable tooling and more.

Sure these are all feasible, but who has the incentive to put in the time to do it? The big 3 vendors have their supercomputer contracts already, so all they need to do is keep maintaining their 1st-party compute stacks. Interop also requires going through Khronos, which is its own political quagmire when it comes to standardization. Nvidia already managed to obstruct OpenCL into obscurity, why would they do anything different here? Downstream libraries have also poured untold millions into existing compute stacks, OR rely on the vendors to implement that functionality for them. This is before we even get into custom hardware like TPUs that don't behave like a GPU at all.

So in short, there is little inevitable about this at all. The reason people may have been frustrated by your comment is because Vulkan compute comes up all the time as some silver bullet that will save us from the walled gardens of CUDA and co (especially for ML, arguably the most complex and expensive subdomain of them all). We'd all like it to come true, but until all of the aforementioned points are addressed this will remain primarily in pipe dream territory.

Re:Intel’s Arc GPUs will compete with GeForce and Radeon in ... by rektide on Monday August 16, 2021 @10:21PM (#28205400)
The paradox I identify in your comments is the start & where you end. The start is that AMD's only choice is to re-embark & re-do the years & years of hard work, to catch up.

The end is decrying how impossible & hard it is to imagine anyone ever reproducing anything like CUDA in Vulkan:

> Sure these are all feasible, but who has the incentive to put in the time to do it?

To talk to the first though: what choice do we have? Why would AMD try to compete by doing it all again as a second party? It seems like, with Nvidia so dominant, AMD and literally everyone else should realize their incentive is to compete, as a group, against the current unquestioned champion. There needs to be some common ground that the humble opposition can work from. And, from what I see, Vulkan is that ground, and nothing else is remotely competitive or interesting.

I really appreciate your challenges, thank you for writing them out. It is real hard, there are a lot of difficulties starting afresh, with a much harder to use toolkit than enriched spiced up C++ (CUDA) as a starting point. At the same time, I continue to think there will be a sea-change, it will happen enormously fast, & it will take far less real work than the prevailing pessimist's view could ever have begin to encompassed. Some good strategic wins to set the stage & make some common use cases viable, good enough technics to set a mold, and I think the participatory nature will snowball, quickly, and we'll wonder why we hadn't begun years ago.

Re:Intel’s Arc GPUs will compete with GeForce and Radeon in ... by BadInformatics on Tuesday August 17, 2021 @01:17AM (#28206455)
Saying all the underdog competitors should team up is a nice idea, but as anyone who has seen how the standards sausage is made (or, indeed, has tried something similar) will tell you, it is often more difficult than everyone going their own way. It might be unintuitive, but coordination is hard even when you're not jockeying for position with your collaborators. This is why I mentioned the silver bullet part: a surface level analysis leads one to believe collaboration is the optimal path, but that starts to show cracks real quickly once one starts actually digging into the details.

To end things on a somewhat brighter note, there will be no sea change unless people put in the time and effort to get stuff like Vulkan compute working. As-is, most ML people (somewhat rightfully) expect accelerator support to be handed to them on a silver platter. That's fine, but I'd argue by doing so we lose the right to complain about big libraries and hardware vendors doing what's best for their own interests instead of for the ecosystem as a whole.