> My understanding was the single market & customs union etc should make going from 1 to N EU countries pretty easy.

Sadly, every country insist on doing everything else his own special snowflake way. There would have to be a lot more harmonization for it to be that easy.