If the dating pool was sufficiently small say below dunbar limit (150) then expanded, there would have been very few ASD (1/52) in the population to mate with. As it expanded that would obviously change and allow assortive mating.