What matters more is that LLMs were popularized and scrutinized to the level that was necessary for people to move on already. We're far from done with AI, but LLMs brought a previously indifferent public up to speed with politics, philosophy, economics, etc.
We don't have more compute with cloud AI. All we have are perpetually rented gpus. The only way to get anyone to pay to rent gpus was to make pc hardware too expensive to buy. That is what jensen did. Jensen colluded with other tech CEOs to raise prices to create artificial scarcity by buying gpus and ram they did not need.
How else are you going to get the terabyte+ of interconnected VRAM needed to run anything remotely frontier?
There is no reason why these high speed interconnects would not filter down to consumer products. The only reason prices are not falling is because of the market collusion to keep prices high.
Right now its $2500 dollars for 4tb nvme raid and a pci-e switch capable of connecting a graphics card to that memory at 60GB/s. This is stuff you can buy during an artificial shortage.
I would have expected cheap 8tb nvme raid cards capable of 120GB/s to be available with the needed pci-e switching for less than that. Collusion denied it to you.