Amazon makes Trainium and Inferentia, and have far more of them available than NVIDIA GPUs. But the software doesn't work as well, so they aren't popular. NVIDIA has a huge software advantage that few people realize.

Agree. But they also have a lot of hardware features. Mixed precision GEMM (fp8 and soon fp3), async copies and now TMA, now global shared memory. And with Blackwell they claim 50% less power, too. They are 10 years ahead of the competition and with a massive budget. I think they reached escape velocity.

Intel and Microsoft had the problem of competing with their previously sold products. Most of their users only needed a basic PC for email, Word, and Excel. Nvidia doesn't have this problem because previous hardware generations quickly become obsolete as the demand for compute keeps growing and it's easier to manage newer clusters.

s/fp3/fp4

I know that the subtext to this is that GPUs will possibly be affordable again, and to that, all I can say is, don't play with my emotions.