The problem is the other countries don't trust the swiss. They are basically being handed a bag of money and being told trust us. Underreporting taxes benefits the 2 parties with all the information (the swiss and their account holders) and the 3rd is left totally in the dark.
Here in Denmark tax authorities have used that anonymous amount transferred to estimate amount of money in Swiss banks which is supposedly enormous.
They've also gone further, like confiscate data about years of foreign credit card payments by Danish shops and search out anyone using a card from a foreign tax haven country based on e.g. shipping addresses for online shopping, or address supplied for hotels and airplane tickets. Except a few high-profile cases like a famous golf player, this had curiously limited criminal consequences, seems like 98% of those caught where just told to pay the tax and interest on the suspicious amounts.
The next step in the tax fraud battle is analysis of all bank payments from Danish bank to any bank in tax haven countries.
The credit card analysis was done in Sweden previously, so it wouldn't surprise me other countries started using that method as well.
Actually, there isn't. You can have accounts denominated in USD, JPY, EUR or any other sufficiently mainstream currency. It's even free if the amount is big enough, which is actually not that high (low five figures).
Don't worry about the banks though, they make it all back and more in their ludicrous transaction fees.
[1] Austria uses a system like this - capital gains are flat-taxed at 25% unless you choose to declare them together with other income, falling under income tax (you'd be pretty stupid to do this considering the lowest income tax rate here is 36.5%, but that's another matter). This frequently causes the OECD and the US (the only country to tax its non-resident citizens, as far as I know) exert pressure on Austria (and Switzerland) to try to get them to drop banking confidentiality; they've had some success lately, privacy has been somewhat eroded.