> So I imagine this revocation of freedom doesn't affect everyone equally. Presumably things are still mostly fine for those folks or at least they wouldn't have experienced it.

Sure, and most Americans have never had their speech censored by a government entity so getting rid of the first amendment would be fine for most people.