But I also somewhat discount that the rising difficulty level is really why more breakthroughs aren't happening, if that were the case one would see larger and larger accumulations of ventures committing capital and failing (or at least operating). I think the real reason is that not enough capital even tries to attack these problems because they're longer term and difficult to quantify the return. The irony is that I suspect that we get a smaller overall growth by routing capital to mostly knowable investment returns over a larger proportion going to "crazy" non-calculable investments. So, we end up waiting for the die-rolls to match up people like Elon Musk with sufficient fortunes for truly big advancements, and an economic system that mucks around with financial engineering instead of relentlessly and systematically advancing a wide range of real-world applied engineering on big problems.
By squeezing pennies out of lots of things, we miss the dollars that could make positive change.
Look at corporate IT as The gold standard of fail. We design complex systems to allow them to be sourced out (is ITIL/ITSM), and then are surprised when we have built a monstrosity that doesn't really work.
You see this type of thinking everywhere. I had an ancient popcorn popper called the "Whirly Pop" that I got in the 90s, which was basically an aluminum pan with a wood handle and metal gear for swirling popcorn on the stove. It recently broke and I bought a replacement -- a product inferior in every way with a plastic handle that will burn your hand, a plastic gear that will melt, and a metal pan and cover so thin that bent it while cleaning with a sponge.
This then results in the need for increased scale, increased productivity, and indeed, the need for innovation disappearing altogether.
These were world changing.
But now we're mostly done doing that and are now in the refinement stage on most technologies where we spend an enormous amount of effort to get, for example, 5% more fuel efficient airplanes. Physics is tough.
Maybe we'll have some sort of revolutionary breakthroughs in the future that lead to another era of rapid invention but until that happens we'll continue plodding along building a slightly more efficient world instead of a transformative one.
This is really just one hypothesis though. The real answer is that no one really knows for sure.