Not helping you advance or making your life difficult, yes, managers can do that, but in general in all the organizations I've seen (in IT corps and finance; perhaps industries like e.g. fast food are very different) if a manager would really want to get rid of someone, it would take them months of "political effort" to try and do so (and they might still fail), because they really did not have that power to just fire someone.
I work at a large company with separate engineering/management tracks, and gaining any visibility into the business from the engineering floor is like pulling teeth. For example, I've been blindsided by reassignments that are technically voluntary but I know if I make a stink about them it'll hurt my reputation. I certainly wasn't consulted about the problem my re-assignment addresses until it was happening. That lack of context creates an environment where employees have to read the tea leaves from the drips and drabs of information they can get, a joke about firing would definitely prompt me to update my resume, just in case.