It sounds like you're not worried about freedom of speech, but complete freedom from the consequences of your actions.
Don't read in what wasn't written - by retribution I meant in real terms like pain, danger, or economic ostracism.
>complete freedom from the consequences of your actions.
Someone in the pro-free-speech camp would not consider getting yelled at on Twitter to be a truly significant consequence. If they did, they would have to be open to the idea in having limits on extrajudicial twitter-flogging.
I'm not sure what you mean by economic ostracism, but people are protected from having pain inflicted on them or being put into danger, as there are already explicit laws against assault and reckless endangerment.
A society where people act outside the government to dissuade speech they don't like (even if they operate within the law) certainly feels less free that one which is more accepting.