Well the State governments at the time ratified the Constitution, so the Federal Government didn't grant itself power; the State governments did.

State governments can still take power away by convening a Convention to Amend the Constitution and then ratifying a Constitutional Amendment.