Saying something like that in a work meeting is a bad idea even if you don't want to play any games. That's just basic human psychology, and if you can't deal with it perhaps you shouldn't be promoted.