kijin's point stands: back then people did not trust the government (and a key related point: they knew that even a republican (i.e. democratic) government could be untrustworthy). Much of that healthy distrust is gone today.
Of course the federal constitution doesn't limit the power of already extant state governments; it's not the constitution of any individual state. Each state has its own constitution which charters, and constrains, the powers of the relevant state government, mostly in accordance with the very same "blanket mistrust of government".
There was no "unlimited power of state governments" at all; every state in the union had its own written constitution well before the federal constitution came into existence. Most of them are even more restrictive of power, and more vigorous in asserting protections of individual rights, than even the federal constitution is.