I do not believe that the author of the memo ever wrote anything like that. I'm not sure that you should equate all research scientists who published on gender/sex differences with nazis.
Well, that escalated quickly[0].
Maybe men are slightly better at something and maybe women are slightly better at other things - why is this an issue? Clearly the difference is not remotelly big enough to be impactful since we see men and women work in every profession. Average worker skill is pretty low so this "genetic advantage" would only really matter at top 0.1% of professionals.
e.g. women are worse at some sports like Tennis, but to most people it will never matter since only few people play at that level where genetics can give you an edge.
That's like me not acknowledging that a black athlete has a genetic advantage over me that would make a difference if we were competing at the 0.1% top level.
I think Google's action is not a right or wrong approach, it's a measure of maintaining order and keeping everybody 'happy'.