There have been plenty of small experiments in other architectures but never enough of a mindshare investment to really evaluate viability and performance of alternatives. There are costs to a more diversified architecture eco-system, sure, but I fully believe we will find more value in that space than we have so far taken advantage of.
ASIC implementation of a PLC, anyone?
It probably means we're worse off, in that spending on software engineering to get gains rather than expecting it out of new hardware processes will almost certainly be more expensive. On the other hand, software gains give us more computing with the same energy which is a good thing for the planet.
By FLOPS I mean the classical FP64, while OPS can be any bit width, even 1 bit.
If you think it will accelerate more while hardware gains drop to zero, why were we leaving these absolutely massive gains on the table? This means that, if a new processor gave us double the speed, we could get more than double just from software alone and get the hardware doubling on top of that.
If you think it will decelerate, why are you happy Moore's Law ends? We're worse off than we were before, even though we aren't "lazy" now.
This approach seems to me a bit like saying "Oh I'm happy I lost my job, now I can finally make money by looking for pennies on the ground all day, which the job made me too lazy to do".