"Right to speech freely doesn't give you magical protection from consequences of your speech."

You are correct. Money and power does it, though. Your boss won't get fired for talking badly about you, in general, but you can get fired for talking badly about your boss.