That's a fair response, so I suppose I should add the asterisk: Conditional on a belief that test scores are correlated with ability level. However, this belief is rather common, and I wouldn't say that it is an intrinsically racist belief.