I'd be willing to bet that once we understand the basic functioning, we'll be able to build a working brain using a few different types of neuron which operate on relatively simple rules-of-thumb, arranged in a few different basic structures which are internally relatively homogeneous.
We absolutely need to start doing what you're suggesting, and figuring out how to derive useful basic structures, represent them, and construct networks using those as the building blocks. My prediction is that's where the field will go over the next 5-10 years, a much deeper dive into how to specify connectivity and usefully control it than has been done so far (we're still using fully connected layers, for the most part, which we know is not a scalable approach as we go from thousands to millions of nodes).
Does it tune itself or is static? It definitely tunes, but it can be meaningful to the algorithm or ignored.
I'll just leave this here: https://en.wikipedia.org/wiki/Gene_regulatory_network
Inside any cell there is a system that works like a neural network - the gene regulatory network. Each gene acts like a neuron, with chemical inputs and outputs. That would make the processing power of any cell on par with that of a small neural net.
I think in a sense this is well-established when looking at real neurons, but several times in the article he uses phrases like "shown to be important for information processing", and that's where I get off the boat a bit. When you're saying that it's so important for information processing that it warrants a 1000x or more increase in the computational power necessary to implement an algorithm, I think it's necessary to dig into what the actual work being done there is, not just that there's some non-trivial transformation. A lot of interesting and extremely tough to model fluid and chemical dynamics are in play when I drink too much water and have to pee, but that doesn't mean that we need to understand them to build a waste disposal system using pipes.
In particular, does the within-neuron processing actively tune itself based on the data it processes to an extent on-par with inter-neuron connections (in which case the argument that it's fundamental to the learning process would hold a lot more weight), or is it mostly static? I think a lot of us consider "important for information processing" to mean "is a meaningfully dynamic parameter involved in a learning algorithm", rather than an accidental shmearing of data.
I'd really love more info on what the actual processing that's happening is.