I suppose if you assume the person to simply be outputs in response to inputs then you could probably create a near perfect simulation, but if you assume the mind has its own internal state that makes that mind distinct, and given that I observe myself as a thinking thing I hold that to be true, then it would take introspection to get closer to the truth.
Let's make tboyd's scenario rather more concrete: suppose the huckster mind-uploader tilts the marketing at a particular religious group that happens to be wealthy. He uses the group's theological terms in their marketing, which is based on a notion of soul quite similar to mainstream Christianity, although the group is more transhumanism-friendly than, e.g., the Roman Catholics, and advertises the dubious product in their newsletter. You are a former software engineer who is studying to become take orders in this group and are convinced the product cnnot do what it claims. How do you go about showing this?