I like to think of this same argument in another (slightly tongue-in-cheek) way: doing this would require solving the human alignment problem. Since this is certainly easier than the AI alignment problem, if we could do it, we wouldn't need to.