Well, an obvious answer is that you contribute to a terrible work environment. If this is anything more than an isolated one-off - say, if it's part of a pattern of behaviour - then woe betide you.