You're quite underestimating how quickly sweeping away humans' rights for "the greater good" turns bad. I'm sure China is justifying the Uyghur camps with your exact sentence.
Here's some history... Basically, the US Supreme Court has repeatedly affirmed that states can take strong measures under the 10th Amendment, and the Commerce Clause can be used for federal interventions.
https://www.americanbar.org/news/abanews/publications/yourab...
[on edit: ALSO, wtf: vaccine refusal isn't a human right... In fact, ensuring vaccination helps satisfy Article 25 of the UN Declaration.]
In this case what is coercion or "consequences" of choosing to say no to the vaccine, will turn into something entirely different.
Here is one example on the subject of contact tracing for Covid and how it can be abused:
https://www.haaretz.com/israel-news/.premium-israel-seeks-to...
Let me ask you this one thing: if I have antibodies already, do you consider that a valid medical reason?
To be honest, if not, then I feel like you are not arguing in good faith.
I am sick and tired of people believing that their "rights" are more important than public health. I would very much wish that people would recognize this for themselves, but I don't see anything inherently wrong with forcing people to comply if they don't. We've done this for decades already; for example, many/most/(all?) school districts in the US require certain vaccinations[0] for children, else they are not permitted to go to school (and in many places, not sending your children to school, without other arrangements, is illegal, so they are de-facto forced to comply, absent allowed religious/medical exemptions).
Sure, you might say that the scope of some of these new and proposed vaccination rules around COVID go much further, but I don't see a material difference. If we haven't been up in arms about requirements around childhood vaccinations, I don't think we can reasonably be upset about businesses requiring their employees to be vaccinated against COVID.
At this point my patience with the vaccine "hesitant" is gone. Unless you have a valid medical reason, if you are refusing to get vaccinated, you are actively inviting great harm on the health of your community, and that needs to stop. I do agree that literal vaccination by force would be going too far. But I am absolutely thrilled that my city requires vaccination for many indoor activities right now, and requires employees at those indoor businesses to be vaccinated, and that many private businesses are implementing their own vaccination requirements. It's the right thing to do, full stop.
[0] https://www.cdc.gov/vaccines/imz-managers/laws/state-reqs.ht...