I'm not generally sold on the "worthy successor" or "human disempowerment would be good" arguments (seems like jumping straight to Hard Mode of alignment when we've not even read the tutorial) but this is one of the ways it might be best for the AI to just… disregard what we say and do something else instead.

We'll get to a point where the best practices are to "tell AI what you want to do, and allow it to tell you how you're going to do it".