That is just an appeal to authority. Once upon a time, that same kind of authority said certain races were sub-human and had few or no rights. The question of whether or not it is a right is completely separate from the current trend of those in power.