Bingo. If anything it would speed up with the population bloom and given society has A: changed our selection priorities and B: made it easier to survive allowing dna to jump out of the local minima we might otherwise be stuck in. Being able to afford for a few steps up hill might find a new valley with a deeper minima.