Similarly when IBM manage to start producing volumes of their neuromorphic chip, Google’s TPUs, Nvidia and even groq LPUs may seem obsolete.
I think this is most likely a temporary blip. GPUs were a bit of a commodity 5 years ago, with Nvidia, AMD, and Intel all producing reasonable stuff. Large AI accelerator chips weren't much of a market ~5 years ago, Nvidia were first to take the market, but in a few years time they'll also be back to commodity status.
Nvidia have a small moat with CUDA, but their eye-watering prices are a huge incentive for users to try alternatives, and ultimately the current price is built on them being the only provider of GPUs with 40/80GB of memory. That's the fundamental enabling technology, and that's not particularly tricky for competitors to replicate.
Nvidia may be the "best" AI accelerator chips on the market for years to come, but being 20% better and 20% more expensive than AMD, and all the cloud providers using their own in-house chips where they can, is not a $1.8Tn company as far as I can tell, it's much more like what Nvidia were ~5 years ago.
so question is: where are these guys' ML chips? sorry but AVX512 is not something that provides enough juice, and apparently some smart-head at Intel decided to lock end-users out of it?
because, honestly, it was not NVidia who kicked the GPUs forward, but these brave CUDA devs who actually created some valuable software to run on top of them - first for crypto mining, then for the LLMs and NNs in general.
honestly - i start to really despise this company, even though there's a 3090TI in my home box. and with the most recent talk given by CEO - fingers crossed someone comes and eats their lunch, they so much deserve it.