What if we were able to make a an exact copy of a human brain, and the behavior was indistinguishable from a "naturally formed" human? Would that still be like a flight simulator vs actual flight?
I think a better analogy is a natural diamond vs an artificial one. Or for that matter an artificial heart. Is an artificial heart vs a natural heart like a flight simulator compared to actual flight?
At some point while building better and better flight simulators we might end up building an actual plane. Same can happen when simulating emotions or intelligence.
All this makes sense without involving Cartesian dualism.
And what about the word "flight"? Most people think airplanes fly, even though they are not autonomous entities, and they don't flap their wings like birds or insects or bats. But is it really flight?
Ok, you probably think yes, of course it is. Then what about submarines? Do they swim? If not, why not?
(yes I am referencing Edsger Dijkstra's famous quote that is relevant here: "The question of whether machines can think is about as relevant as the question of whether submarines can swim.")
Whereas when robots get advanced enough, it'll be the difference between a model plane and a parrot. They both fly, even if they achieve it slightly differently.