Well yeah - at that point you could trivially start mapping relations in those groups which to families who are advantaged materially or culturally in the sense that nine year olds usually only have access to genetics textbooks and latest papers lying around their home if their parents are genetics professors.

I am pretty sure the British royal family has distinctive combinations of genes which are of course strongly correlated with a college education!

Or, it might be evidence of systematic racism. Would it surprise you that the genetic bouquet associated with people of color would also correlate with a long history of racism, which includes poverty and denial of education?