>Damore suggested in his memo, mightn't these innate differences mean that women are less likely, on average, to prefer careers in software engineering?

As far as I understood it, this wasn't the bit of the memo that people were attacking.