I think a lot of the tense reactions come from the notion that governments have leveraged the opinions you speak of to impose extremely illiberal sanctions on liberties we used to take for granted, such as telling us whether and how we are allowed to see our own families.