When this has come up before there are always a couple people who say they can't listen to music in a language they know, but listening to another language doesn't bother them.

For me, and one of the reasons I HATE open office plans, I cannot focus if I can almost hear a conversation. Speaking at a normal tone would be far less distracting. Similarly, someone is speaking in a language with too many borrow words in English. Overhearing Germanic languages in particular, my brain keeps trying to treat it like an English speaker with mush-mouth or having a stroke. If I just squeeze my brain harder with my furrowed brow, it will all make sense.