There is no universal right for citizens of one country to enter another country either, even within the EU (there have always been limitations based on considerations of public security, public policy and public health grounds).