If neanderthal or denisovan genes were ancestral, you would be able to find them broadly in African genomes and some of them wouldn't carry adaptations to environments not found in Africa. Instead they reinforce (and inform) our understanding of early human populations out of Africa.