I am more or less sold on (possibly deterministic) chaotic models for things like tinnitus.
That's close enough to "a complex model we cannot understand" for me.
To me, this sentence seems to mean that it may be possible some time down the road to “know enough” and create a complex model of the human brain that’s understandable. There are also some in philosophy who argue that humans may be cognitively closed off to understanding things like the human brain [0]. They note that humans have biological limits to understanding certain things just like an animal might. For instance, an ant, may have biological limits to its understanding of how certain things work.
What do you think of philosophers who argue of cognitive closure?
[0]: https://en.m.wikipedia.org/wiki/Cognitive_closure_(philosoph....
As it happens, I think it is probable that such a model is possible in principle, and also that a complete model would not be understandable (in which case, Bonnini's paradox would apply, but it is not the reason why we currently don't have such a model).
With regard to cognitive closure, I think the first sentence of the article you link to is trivially true, but I have yet to find a good argument against physicalism in matters of the mind, and philosophers cannot agree among themselves. I think it is interesting how little attention is said about biology in these arguments (Paul Churchland is one exception.)
And maybe we understand it. Worse, we think we do.
Newton didn't have to have a complete and thorough understanding of how physics actually work, the model is not an intentional simplification but subtly wrong because noone know better at the time; however, the Newtonian model still is really helpful in comprehension of the problem domain so we still teach it to students and use it in practice.
For simple systems, obviously this is not as much of a problem, or not a problem at all.
This assertion would only be justified if we knew enough to create complex models that we do not understand. The reality is that we don't know enough yet to create any sort of working model of the whole human brain and its thinking processes.