What market forces stop vendors selling small quantities of far better tech at far better profits? Price discrimination is fundamental in marketing: different people will (can) pay different prices. An extreme example: I believe the military gets more advanced process nodes, when there are only small runs, before mass production.
I think the iPad Pro answers that. Could you buy or design a faster mobile processor than the A12X?
"High volume, high profit" trumps "low volume, extreme profit".
I think that's always been true for CPUs and GPUs. The faster ones were always the more expensive ones.
If you are cringing at the idea of a 3k+ cpu (or 9k+ gpu), it quite literally wasn't built for you.
As one extreme counter point, the cheapest smartphones today have better performance than the original iphone.
Audio is one of the big areas where we can see huge gains, and I think philosophies about optimization are changing. That said, there are myths out there like "recursive filters can't be vectorized" that need to be dispelled.
Things being tricky with AVX and cache-weirdness doesn't change the fact that if you're not vectorizing your arithmetic you're losing performance.
There's also an argument to be made if you're writing performance critical code you shouldn't optimize it for mid/bottom end hardware, but not everyone agrees.
Also, in the wider socioeconomic picture, everyone once got the same computational technology eventually, because better was also cheaper.
Now, computation is stratifying, like any normal industry, where you get what you pay for. This ending of egalitarianism is bad.