Which is pretty much exactly what I said in my post.
Go read the Federalist Papers, there is no way the founders intended it to work that way and courts have never interpreted it that way either. James Madison explains it beter than I can:
“If men were angels, no government would be necessary. If angels were to govern men, neither external nor internal controls on government would be necessary. In framing a government which is to be administered by men over men, the great difficulty lies in this: you must first enable the government to control the governed; and in the next place oblige it to control itself. A dependence on the people is, no doubt, the primary control on the government; but experience has taught mankind the necessity of auxiliary precautions.”
(Also the federalist papers pre-date and argued against the Bill of Rights. Which means they're a strange authority to reference in this context.)
Either way, that doesn't answer the point of whether this argument by Madison is valid or not.
There's a lot more to the Constitution than just the Bill of Rights, but most people only seem to remember the latter.