There is no intelligence test I know of that can perfectly control for advantages and disadvantages in education / home life.

Not everyone is as well-positioned as you might have been to excel at an IQ test. And to the extent that someone is disadvantaged, their race may indeed be an indirect cause.