But the people who use their credit
  card company instead of email or
  the prominent Cancel button on the
  website don't tend to ever respond
  to those mails.

What's the user experience for someone whose credit card details have been stolen and used to sign up for your service?

Presumably such a person wouldn't have the credentials, the e-mail, or the cancel button?