By definition, if you doubt someone's story, then you don't believe them. It's fairly simple, but if you would prefer to pretend that you didn't say what you said, that's certainly your right.