It's about Government's ability to restrict or punish free speech, for example, by making you disappear (e.g. China per Hong Kong and Uighur brainwashing, Saudi Arabia bone-sawing journalists).

There can be, and are, private consequences to speech. I may not invite you back for dinner for example, other consequences may be more impactful.