Take that argument to an extreme. If the majority of the country votes to suspend democracy, would you stick around? If not, then doesn't that imply that there exists a set of underlying principles that you believe are fundamental to a government? That's exactly what the Bill of Rights is, an enumeration of what were viewed as the fundamental rights for which the point of government is to preserve.

The mistake so many people make is thinking that government is the lowest level. It is not, government is downstream of culture and is a reflection of that cultures values. Without a unified culture that agrees on certain prerequisits of government, for example from this case elected representation, there can be no functional government.