Exactly. Which is why, when there is an epidemic of a dangerous disease, measures need to be implemented that assume that everybody is infectious unless proven otherwise.

No, that's not the point. If the small risk of someone dying from covid19 is enough to take away everyone's rights, what keeps your state from taking away your rights for a similarly flimsy reason, such as the risk that you will commit a crime?

Laws, constitutions, the legal system, and the ballot box.

Mature democracies should have the ability to carefully and responsibly limit some rights in times of great crisis, such as wars and pandemics.