It's true (pretty much by definition) that rhetorical power is a form of power. But it's a further, cynical step to conclude that if someone acts in a way that confers rhetorical authority, they must be doing so just for the sake of that authority. You're assuming away the possibility that someone might be genuinely acting, at least in part, from principle.