The main point is the brain, as far as we know, is reducible to the known laws of physics, which, as far as we know, are entirely computable. Therefore, if human beings exhibit non computable phenomena, such as functioning as halting oracles, then that is a good reason to believe the mind does not reduce to the brain. And we could call this 'mind' a new form of matter or something, so that people don't get alarmed by non-physical phenomena.
This is where I disagree. It would, to me, seem to be a good reason to believe we've missed something about the way the body (not specifically the brain) works.
> And we could call this 'mind' a new form of matter or something, so that people don't get alarmed by non-physical phenomena.
This just sounds like you are eager to label any new phenomena "non-physical". There is no reason to pull the extraphysical gun just because you are stumbling upon new physics.
In the article the point is a bit subtle, but partial oracles are still not Turing reducible. The point of the article is that the fact humans cannot solve all problems does not imply they are Turing reducible.
At any rate, from my cursory analysis, it appears the notion of a non Turing reducible human mind is empirically tractable, so I still don't understand why it is not a viable scientific hypothesis and why AGI is assumed to be necessarily true. The mind as a partial oracle would imply AGI is impossible.
Thanks for the link, I'll be checking it out!