Yes but compared to the size of their economies - let's keep it simple by looking at the GDP - the UK would be hurt disproportionately more. The UK GDP is ~$2.5 trillion, the EU GDP (sans UK) is ~12 trillion.