OP didn't say he would quit because one of his colleagues held a (in his example) racist opinion, but would do so if the company just turned around and said that black employees should just be "more open-minded" to those opinions.
You can separately debate whether the original memo was as bad as OP's racist example, but in the context of OP's example I think he'd be perfectly in his rights to leave if the company was supporting such an opinion.
I think a more direct parallel here would be if you cited such research, and then drew the conclusion that IQ translates directly into better performance in a specific role such as leadership.
The memo author made claims that aren't supported by the research he cites. It isn't a mischaracterization to say he questioned the aptitude of women in certain roles without having the science to back it up. That's a problem -- not a legal one, but a "how to work well with others" one.
> Besides, if you quit a huge company like Google because one of your colleagues holds an opinion, then how are you so different from a white who wouldn't go to school anymore after the first black joined?
This is an oversimplification of what I said and also doesn't make sense even on it's own. A black person's mere presence at a school does not negatively affect the other students at the school. A person more senior than me who holds the belief that for some made up biological reason I am less capable than someone else can actually negatively affect my career.