In principle there is a selection pressure against it if it's even 1% genetic. But that pressure might not be strong enough to have a large effect very soon (especially when very few people today seem to be actively motivated to have as many children as would be physically possible for them).