It wouldn't be so much about the rights themselves being authoritarian, but that opening up the framework for renegotiation would weaken existing norms. You could, for instance, almost be certain that some countries would like to put more limits to freedom of expression.