I think we should consider the possibility that growth in processing power will level out at least for a while. There are some interesting research avenues which may yet bear fruit, but there's no guarantee that some miraculous scientific breakthrough will appear just in time to salvage exponential growth. "Moore's Law" is not some fundamental law of the universe.
Seems like plenty of people even if they don't believe in Father God, they still have some kind of faith in Mother Nature, or Brother Progress that have our backs covered whatever we do.
By what metric?
Biological neurons misfire and make errors all the time. Biological neurons don't like -40C or 100C very much. Biological neurons get rather upset when you subject them to a couple of G's of acceleration.
For example, just a few days ago a team from UCSD announced something like that called 'memprocessors'.
"The actual machine we built clearly suffers from technological limitations, that impair its scalability due to unavoidable noise. These limitations derive from the fact that we encode the information directly into frequencies, and so ultimately into energy. This issue could, however, be overcome either using error correcting codes or with other UMMs that use other ways to encode such information and are digital at least in their input and output."
So, it remains to be seen how feasible this machine is.
The historical argument boils down to: "we've managed to do this a few times in the past, THUS we'll be able to do it indefinitely".
Hardly a logical or coherent argument.
Of course, all of that is about discovery - and pre-conditioned on there being something useful to discover. Whether there is or not is necessarily a matter of faith... since, by definition, we don't know. Historicaly it's turned out that way, but rephrasing you, past performance is no guarantee of future performance.
Personally, I see Chaitin's work as showing that there is infinite pattern; and with infinity, some of it is bound to be useful. It's a matter of finding it.
Of course, in the present case we already have a proof by existence that better technology is there to be discovered: you.
It's like Peak Oil - when the straightforward methods are exhausted, the price goes up, making it viable to explore other avenues that were comparatively inefficient before. Think about an intel-killer. Think about VCs thinking about an intel killer. Some tech may turn out to be much better than expected. To change the figure again, those neglected minor veins may lead to greater deposits, as has happened before.
There is so. much. demand for this.
eg biological neurons are far superior to our best silicon.