The UK isn't even remotely comparable to either of those countries. Besides, both Switzerland and Norway have trade agreements with the EU. If the UK wants similar agreements it'll have to accept similar conditions including freedom of movement, which in turn will make this whole Brexit affair rather pointless: The UK will effectively have to accept the same conditions it has right now without any ability to influence or veto EU regulations anymore.
How does that invalidate what I wrote? Are you proposing that the Swiss would be better off with a Somali income and cost of living?
Is this still true when X=Switzerland and Z another random country in UE?
And maybe you can't see it, but stuff that the Swiss import is for them very cheap in comparison to all others. Just imagine how less it'd hurt you financially to pay for an iPhone when you have an income that is much higher than in every surrounding country.
Or how about going on vacations. That's very cheap for Swiss too, because for them basically every country they could go to is insanely cheap.
Edit: And the funny thing is, they are not in the EU, every male has a automatic assault rifle at home, they have free speech, regular referenda on important matters and the majority there is against any kind of Socialism.