The thing is, when humans conquer a rival group, we tend to rape the survivors. That kind of ensures genetic mixing, so this kind large discrepancy in innate ability couldn't really appear.