Can you remote access your home desktop from outside Switzerland? :)
If someone where to be caught doing that, she/he would not be able to say it was technically possible so it's OK. It's technically possible but legally forbidden. So the message is: do it at your own peril.
Reality and law don't always agree but when these things go to court, law has the upper-hand :)
What about IT people? Such companies generally bring in IT professionals for projects from other entities such as the US headquarters.
It's unlikely that an US top executive has a valid business reason to see Swiss data when visiting the country. If such a reason exists he can surely see it, but it's probably illegal to take the data out of the country in any form. (I'm guessing here, but Swiss criminal law is quite finicky on the issue of bank secrecy).
If the top executive tries to asshole his way into the data (as in: "hand over the data, or you're fired") any halfway smart employee would immediately inform compliance, where a whole cacophony of alarm bells would go off.
As for IT professionals. Sure, a lot of foreign IT professionals work for Swiss Banks. But the need to access actual customer data is very, very rare. If the need exists, they can surely see it, but only from within the country's borders.
To clarify what your Goldman friend meant.
Swiss banks are obliged to keep customer identifiable data ring fenced and within the country. That is, it can't even be processed offshore. It has nothing to do how the entity is setup legally.
For example (I work for a Swiss bank). I can easily remote access my desktop from home, or, if I have my laptop and token with me, from any other location in Switzerland.
There is no way to access the systems from outside Switzerland.
Singapore, btw, has comparable laws and also ring fences data for use only in Singapore.