"Compacts must be reciprocal, this principle would not in such a case be preserved. The Constitution requires an adoption in toto, and for ever."
https://founders.archives.gov/documents/Hamilton/01-05-02-00...
Madison also called this out.
http://press-pubs.uchicago.edu/founders/documents/v1ch3s14.h...
In typical modern language;
A _Federation_ is a union of _partially_ self-governing provinces, it is not a _conFederation_ or a union of sovereign states.
But even our original government before the constitution was titled "Articles of Confederation and Perpetual Union"
Those who push the Pseudo-historical Lost Cause ideology and deny slavery was the principal cause of the secession, often use the 'states rights' dog whistle, but there never was a right for secession for anything like a perceived risk to chattel slavery.
Sure there are lots of arguments of where one could argue where the boundaries in powers should exist, but the fact that secession is not mentioned in the constitution or in the various state charters simply disproves the common claims by the Lost Cause ideologists.
That changed with Appomattox and the subsequent enactment of the 14th Amendment.