It might be the passive aggressive attitude itself rather than a reaction to the language. A frequent example is Parisian waiters in bistros. It is an old tradition for the waiter to be slightly cavalier with the clients, and for the clients to respond in kind. But it’s a kind of a parisian joke. Though I get how it would put off foreigners. But many other trades have their ritual (like a souk in Marrocco).

As a French, let me tell you that I find the behaviour of many Parisian waiters rude and unprofessional, perhaps that's because I'm not Parisian though..

To call it a game is being rather hand wavy. It's not a game if the hapless tourist isn't in on it.