I don't read that assumption into BoiledCabbage's statement at all: "[..] when we understand it well enough to realize we're the same type of parlor tricks?" This clearly implies a (hypothetical) deeper understanding of processes in the brain and their specific qualities, rather than (as you seem to be implying) a mere comparison of the outputs.
Edit: anyway, the criticism section opens like this:
>Historically, positivism has been criticized for its reductionism, i.e., for contending that all "processes are reducible to physiological, physical or chemical events," "social processes are reducible to relationships between and actions of individuals," and that "biological organisms are reducible to physical systems."
This (at least the 1st and 3rd quoted item, while I think the 2nd one is just out of scope) is exemplary of the kind of things that are obviously true for anyone but a subset of philosophers clinging to magical and unprovable beliefs about the human mind. I asked you to elaborate your argument precisely because if it all boils down to simply rejecting physicalism (in philosophy of mind terms) there's nothing new to argue about. The recurring discussion about "AI can never be like humans" is only interesting when the participants do a little bit more than just staking out their own position in idealism vs dualism vs physicalism terms and regurgitating all the known debates between these camps.
And what do you feel when we understand it well enough to realize we're the same type of parlor tricks?
It seems pretty clearly when and not if. Not sure what you're reading there.
https://dictionary.cambridge.org/grammar/british-grammar/if-...
The comment is written in such a way that it assumes this is the nature of reality and at some point, we will learn that the human mind is no different from the parlor tricks of LLMs. This is what I was criticizing.
Again your whole point seems to boil down to simply denying physicalism (unless you have something more subtle in mind about the limits of physical science). It's a valid position to take but not very fruitful for further conversation.
What’s wrong with the speculation is that it’s a positivistic argument that is needlessly reductive. It’s reductive because it assumes that appearing human-like is equivalent to being human.
The fact that we can understand how “AI” works as a parlor trick yet appears human-like in no way implies that human beings are nothing more than the same parlor trick processes. To argue that it does is to make a positivistic argument that doesn't take in account a whole host of other things. As noted in the Criticism section of the article (which is hardly 5,000 words) there are many issues with this approach.