Good point. Though a lot of the backlash against public health emergency powers actually being used when necessary is of a fairly knee-jerk, borderline anarchist nature (reminiscent of some recent anti-taxation movements that have been similarly vague). There's a difference between calling for government to have stronger protections on a particular right or freedom, vs simply rejecting any instance of government having a direct impact on your life.

It tends to be accompanied with a belief that things are not that serious or that there won't be a real benefit from the measures.

And the worst versions impute sinister motives among those implementing controls: that it's an attempt to suppress economic activity and make people slaves of the government/elites/etc.