Well, we also don't have the freedom to murder or steal (and numerous others besides, like letting our dog crap all over the street, employ child labor, even if "consensual", and so on) So there's that.