What you're forgetting is that the cabinet serves at the pleasure of the President, they are not counter parties to him. They carry out direction from the President. They can be fired and replaced very quickly.