I believe his response to that was that people were purposely misinterpreting what he said. I haven't looked into it in detail for a while, but last time I did, it seemed like a perfectly reasonable defense.