That's not fair summary of the document at all. In fact Damore was aligned with the purpose of the diversity groups and trying to reason how what is known about different preferences and personalities between men and women could be used to help improve diversity at Google.

For example, Damore's memo has a section where he reasons that one reason women may not be promoted as often is because Google is organized to recognize and reward individual accomplishments rather than participation in groups. Damore theorizes based on cited research that women may be more inclined to contribute in group based settings rather than all alone, and so perhaps aligning promotion to recognize group contributions too would help diversity.