I (wish) that it is possible to have a multicultural society without having large swaths of population who want to do others harm
There's so much research out there that shows that multiculturalism is the root of conflicts. For example [0] and see references too.
Just look at the current French republic and how that worked out for them. [1]
[0] http://arxiv.org/abs/1110.1409
[1] http://www.telegraph.co.uk/news/worldnews/europe/france/1199...
I'm not saying we're a shining model or anything, but we have a ton of different cultures living together more or less harmoniously, even taking into account the habitual blacks vs whites squabble.
You'll get people fighting over how they think the place ought to be run. You'll get people fighting over who gets what and why these guys have all this stuff and we have less stuff. If nothing else, it comes down to availability of resources and numbers of people (along the lines of Dunbar's number and all that).
Sure, ethnicity, race, and religion are convenient signifiers of groups of people and usually when you have two or more groups with significantly different cultures, you've probably got two or more groups with some level of inequality and power imbalance so you're already halfway there. But even if you don't start out with cultural differences, they'll pop up eventually. Groups of people over a certain size will always have a harder time avoiding conflict when things get tough. It's almost in our nature to split into "us" and "them" just to manage it all.
Now if both countries would import so much people from middle east that they would constitute something like 30% of the population of each country. Now ethnic Germans and Swiss seem to be "the same group" compared to Muslims. If shit hit's the fan, there is new pressure to readjust the borders. And move the people. Usually that stuff causes bleeding.
You could say that "if" is completely unrealistic right now. I agree. Nothing that has happened in Europe during past 15 years really warrants any policy change regarding immigration. The point was largely theoretical, just like your island.
We have many proofs of example (I mean, such a sweeping statement should apply to any society with more than "one culture" whatever that even means).
And even if you were right, that it hasn't happened before, you could say that about anything that didn't work the first time. "It never worked before, so it is doomed."
No real progress in stopping multicultural violence has been made since slavery was abolished. People are less violent overall when life is comfortable. But Balkans war and Syrian civil war show that nothing fundamental changes with few generations of peaceful living.
This is why privacy is doomed in "multicultural" societies.