That's the point of Federalism - local autonomy where it makes sense, coordinated direction from above where it makes sense.

Small countries don't have much leverage on their own on the world stage. CA and NY are almost certainly better off as part of the greater whole.