Calling women who politely contradict you “hysterical” is sexist, full stop. When you inadvertently use offensive prejudiced language out of ignorance, and people point that out, the appropriate action is to apologize and try not to do it again, not start making excuses. https://en.wikipedia.org/wiki/Hysteria