Most of our attempts to quantify intelligence have shown a correlation with race. That's evidence of something- either bad tests with cultural bias, or differences in intelligence between races.

I think most people recognize that the latter idea would be really bad for society, and thus requires a pretty high bar of evidence to consider, and IQ tests are far from good enough evidence.