Although that leads to the mother of all natural selection - after a few generations, you'll have selected almost exclusively for families that have lots of kids. My bet is that fertility will flatten out and recover a good bit over the next few decades.