A manager with a sense of humor is different from a manager who jokes about ending your employment. Imagine getting pulled over and a cop jokes about arresting you- are you laughing or do you feel unnerved? You were being sarcastic, but unnerving employees by making jokes rooted in your power over others does have the potential to negatively impact company culture and thus the company itself. The power dynamic matters.