I would consider their open efforts to be "not serious" for anyone but the consumer space - games, desktop users, maybe even professional text editors. If you're using the GPUs for "professional" applications in a one-off scenario, even AMD falls short.
I'm honestly not sure what the moral of this story is.
That said, I think AMD isn't really competing with Nvidia. Sure, their R&D budget is smallish but it feels like they're somewhat fine with the current status quo.
So does AMD.
https://git.kernel.org/pub/scm/linux/kernel/git/firmware/lin...
And while they have an open version of the userland, it's also missing features compared to the proprietary one, etc.
Besides, in the end it truly hardly matters whether the firmware is loaded at runtime or lives in updateable flash. It's still not "your PC" in the Stallman sense either way, it's been tivoized regardless of whether firmware is injected at runtime or during assembly.
Firmware is also the only way to get proper HDMI support... which is why AMD still does not support HDMI 2.1 on linux. HDMI Forum will not license the spec openly and implementations must contain blobs or omit those features.
Can we really assign blame to them specifically for not fighting the hdmi forum on our behalf?
That people will go with what is easier and works?
That open source and open standards don't win by default? That it takes a lot of persistence and effort.
AMD is working on moving to things like the open source form of AGESA. They plan to start deploying openSIL by 2026.
"Open source" by itself is not a magic dust you can sprinkle on your projfcts that will make your software work well.
It probably takes a lot of confidence in your software developers to make this kind of decisions.
NVidia decided to use gimmicks to sell their cards including texture compression, lighting tricks, improved antique video encoders, motion smoothing, bad proprietary variable refresh rate, ray tracing, cuda and now machine learning features.
Nvidia is fortunate that machine learning has taken off. That is masking AMD winning market share from weak overpriced NVidia 3D products!
Texture compression: Useful for games, ongoing work, although I wish they would make cards with appropriate amounts of VRAM
Lighting tricks: Not sure what this is referencing
Improved antique video encoders: NVENC started out with only h.264, but now it supports h.265 and AV1, which aren't antique at all. Niche, but widely used in the streaming industry.
Motion smoothing: The hardware optical flow accelerators in newer cards are important for DLSS, which is a bit gimmicky but works mostly as advertised.
Bad proprietary vrr: No argument here, gsync sucked.
Ray tracing: All 3d games are going to be ray traced sooner or later. Getting a head start on it is a good move, and it's a big head start. The 4090 is ~100% faster than the 7900xtx.
CUDA: No one can seriously call CUDA a gimmick.
Machine learning features: Tensor cores are great.
CUDA isn't a "technology", its a shader language that has been supplanted by better industry-wide standards.... the same standards whose shader languages are compiled by the same Nvidia shader compiler.
CUDA is a moat whose muddy waters has long since ran dry, and you're drinking koolaid if you think its still relevant for greenfield projects.
So I want to start a new GPU compute project today. Obviously this will primarily be deployed to AWS/Azure/etc, which means only high-end GPUs available are Nvidia. What do you recommend developing this application with?
The way I see it, you would have to be drinking koolaid to use anything besides CUDA.
OpenCL is the actual intended replacement for all the pre-standard APIs, and has achieved its goals. If you want SPIR-V IR, OpenCL allows this and all the major vendor impls support it.
CUDA has no equivalent for SPIR-V, and never will. Nvidia's own internal IR is not, and never will be, documented nor stable across driver versions. This is a massive downside for ML middlewares, as they have no way of directly emitting optimal code that cannot easily be represented in the HLSL-flavored syntax in CUDA.
Are you talking about Vulkan? If so, I'm not sure 'supplanted' is the right word.
As someone who uses industry-wide standards in a related field...
The proprietary implementation often has the benefit of several more years of iteration with real products than the open standards. 'Supplanted' can only really be evaluated in terms of popularity, not newness or features, because features on paper aren't features in practice until they pay for their migration cost.
thats not true, since the switch is based on an nvidia platform. since it's still 1/3 of the market, it's not as bad as it used to be.
At some point, hardware (necessarily?) evolves to become optimized to do one thing, and then you have to just treat the driver as an API to the hardware.
Even "simple" things like keyboards and mice are now small computers that run their own code, moreso more complex devices like sound cards and hard drives.
And since graphics card performance seems to be the bottleneck in a lot of computing, it has become super specialized and you just hand off a high-level chunk of data and it does magic in parallel with fast memory and spits it out the hdmi cable.
As a result, with things like XLA now supporting AMD GPUs using RoCM under the hood the feature gap has closed A LOT.
Sure, Nvidia still has the performance crown lead with CuDNN, NCCL, and other libraries providing major boosts. But AMD is starting to catch up quite fast.
According to the latest ROCm release notes, it supports Navi 21. Well, at least the pro models. It doesn't even mention the 5000 or 7000 cards. My current understanding is that 7000 support is mostly there a few months late and 5000 was abandoned partway done after years of vague promises.
At least it might support windows soon. Not my sub-4-year-old GPU, of course, god forbid. But most of the rest of them.
https://www.google.com/search?q=amd%20debt%20to%20equity%20r...
Hardware is very capital intensive. They've not been making much until much more recent. From 2012 through 2017, almost all years were a net loss. They hit $1B net profit only in 2020. I imagine quite a bit of that money went into keeping/accelerating the pace of Ryzen, and paying off debts. Only now do they have more breathing room for other endeavors. If they diverted a chunk of that change to AI, they probably would have a lower performing Ryzen right now.
So no, they did not have piles of money.
Just having 30 extra good software engineers focusing on AI would have made such a massive difference, because it's so bad that there's a lot of low hanging fruit.
As someone who was pretty invested in AMD stock since 2018, it always made me pretty angry how bad they managed the AI side. Had they done it well, just from the current AI hype the stock would probably be worth 50 bucks more.
Hindsight bias much?
How easily we forget in today's speculative AI bubble that AMD rolled into 2018[1] with 6.1x levered D/E and substantial business uncertainty while the Fed was actively ratcheting interest rates up, and ended the fiscal year still 3.3x levered despite turning operationally profitable[2].
> Had they done it well, just from the current AI hype the stock would probably be worth 50 bucks more.
It strikes me as pretty audacious and quite unconscionable to assert "big mismanagement" while simultaneously crying about speculative short-term profit taking opportunities.
[1] https://www.sec.gov/Archives/edgar/data/2488/000000248818000...
[2] https://www.sec.gov/Archives/edgar/data/2488/000000248819000...
As someone who had like 25% of their portfolio in AMD, it was pretty infuriating being forced to buy Nvidia GPUs every single time because the AMD ones were literally useless to me (lack of AI support and cuda in general).
Yes, there's AI hype right now. But Nvidia gpu datacenter growth isn't new. And AMd were asleep
The problem they ran in to looks to me to be that they focused on targeting a cost-effective low end market and were caught off-guard by how machine learning workloads work in practice - huge burst of compute to train, then much lower requirements to do inference. That isn't something they were strategically prepared for and that isn't something that software industry has seen before either.
Won't save them from market forces, but their choices to date have been reasonable.
>Nah. AMD was already profitable in 2018. This is just big mismanagement.
I guess you know they have debt, and they were paying them off, and were battling with other issues all the way till 2019 / 2020 when Intel had their misstep so they could gain something in the CPU server market?
But let's asume they thought it was too expensive back then. There's still no reason not to invest in software in 2020 when their gross margin was absurd.
- -27.5% YoY revenue decline
- -6.3% YoY gross margin decline
- -$481M operating loss
- $230M short-term debt
- $388M non-cancelable operating lease commitments
- $538M unconditional purchase commitments
- $2.032B long-term debt (!)
- -$412M stockholders' deficit (!!)
Seriously, look long and hard at those numbers, and when you think you understand what they might mean, consider them again and again until the feeling of insurmountable adversity sinks in and you're on your knees begging public equity markets for an ounce of capital and a pinch of courtesy faith...on the promise of meaningful risk-adjusted ROIC to be delivered in just a few years.> But Nvidia gpu datacenter growth isn't new. And AMd were asleep
...which is why this remark comes off as sheer arrogance (no disrespect).
Su and the rest of AMD leadership certainly weren't asleep. The difference here is while you're busy scouting speculative waters defended by competition with deep battle pockets and an even deeper technical moat, Su was simply preoccupied bringing a zombie company back to life and building up enough health to slay a weaker giant.
Personally, I was already beyond impressed with one miracle delivered.
[1] https://www.sec.gov/Archives/edgar/data/2488/000000248816000...
This has been their claim, but more often than not they haven't actually done anything to encourage the community to pick up slack. So many of their graphics tools have been released with promises of some sort of support or of working with the community yet have basically had nothing to help the community help them.
Even accepting the unreasonable idea that they can't afford the full-time developers for the various tools and libraries they come up with, they often don't even really work with the community to build and maintain those.
One of the bigger cases which contributed to turning me off from AMD GPUs was buying a 5700XT at launch, only to be led on for over a year about how ROCm support was coming soon, every few months they'd push back the date further until they eventually just stopped responding at all. Trying to develop on their OpenGL drivers was a similar nightmare as soon as you wandered off the old well worn paths to more modern pipeline designs.
Another glaring example would be Blender's OpenCL version of Cycles, which was always marred with problems and hacks to work around driver issues. They tried to work with AMD for years before finally just dropping it and going for CUDA (and thus HIP) even though AMD's HIP support, especially on Windows, is still in a very early state.
Compiler ecosystems can and have changed rather quickly. Especially given that most NNs run on a handful of frameworks. Not _that_ many people are writing directly on top of CUDA/cuDNN.
Make an equivalent toolchain that runs on cheaper hardware and the migration would be swift.
Currently AMD hardware is a bit behind and the toolchain is frustratingly buggy, but it's probably not as big of a moat as NVIDIA are trading on. Especially since NV's toolchain isn't particularly polished either.
Until a couple of years ago, AMD was in survival mode, fighting Intel in one side and Nvidia on the other. Two rivals that were making money hand over fist at the time, while AMD was bleeding money.
AMD made investments on open source frameworks and libraries commensurate with their financials at the time, the hope being that the community could help pick up some of the slack preferring an open source solution that could evolve with its users. The community, understandably, went with the proprietary solution that worked well at the time and had many resources behind.
The net results is that the Nvidia ecosystem has taken a dominant position in the industry and gets all the benefits from being a quasi-standard. On the other hand, open source efforts by AMD or others get viewed as "not serious".
The financial situation of AMD has improved somewhat over the last couple years. So AMD is "taking AI more seriously now". But it is probably too late and the proprietary ecosystem won.