What you describe is a different scenario. For example, one of my clients was a company in Sweden. Almost no Swedes were in the team. The de facto language for the team was English, even though Sweden's official language is Swedish. The poster's logic would insist that everyone speak Swedish (or one of Sweden's minority languages), even though everyone knew English. While you would say that's fine.
I've also worked for an Austrian company where nearly everyone spoke German most of the time. (Not all of the time; unlike the main thread, I did have chit-chat and work-related conversations. But coffee breaks and lunch were mostly in German.) Okay, I was the outsider. I'm also the outsider when people talk about bands, movies, and sports, since I know so very little about those topics compared to most. That's life?