You should only show a dialog before an action that cannot be undone. So, the "not Cancel" button in a dialog should always be destructive, and "Cancel" should always be the safe choice.

Also, Red is the universal color for danger. That's why the action button is red.