I think it's more likely heritable attributes follow a normal distribution, rather than have a variance of 0. I wouldn't expect everybody to score the same- there seems to be (biologically speaking) a process which leads to variable levels of attainability of intelligence. Anybody who actively denies that men and women have different height distributions is just being non-scientific to avoid pissing off somebody.