Populations of people that think birth control is a good idea and are quite happy to defer their children until later in life still reproduce in sufficient numbers to remain the majority in developed countries, especially assuming that many offspring of reproductive fanatics will end up "defecting" and behaving according to the prevailing social norm rather than their parent's preferences or inherited instincts.
Given the continued reproduction of people who think birth control is a sensible idea, women should have careers and more than three kids is a headache, I think heritability of desire to have large families would have to be almost deterministic for us to start to worry about hyper-fertile people taking over.
Being "reasonable" and "planning" are just extremely maladaptive in the current world. For example, reproduction in this population is completely dwarfing reproduction of highly educated, self-controlled, non-criminal groups: http://www.amazon.com/Promises-Can-Keep-Motherhood-Marriage/...
The same argument (falsely) applies to homosexuality. Since homosexual people don't pass on their genes, surely they must be bred out of the population? Well, estimates put the rate of homosexuality between 1% and 10%, so that didn't really turn out the way the purely-genetic argument would predict. It's just more complex than pure genetics.
The argument about homosexuality is similar to asking why amazon hunters keep getting killed by jaguars - you could "disprove" evolution by asking "why hasn't evolution just selected the ones resistant to jaguars?" But it's because getting as close to danger as possible is an effective strategy. That's one of the more reasonable genetic explanations for for why homosexuality still exists, too.
So as modernity attacks the desire to reproduce (with abortion/birth control, modernity, education, distraction, late marriage, etc.) we end up eliminating people who are vulnerable to not reproducing. The only people left will be ones who are resistant.
So my overall point is, even though the population growth rate may be slowing down, it doesn't mean it'll slow down forever. There are already resistant strains at low frequency in the population now - they will increase in prevalence and become the majority; they'll continuously suffer defections, some of whom will be high achievers due to not spending the time to reproduce, and the mindset that allows them to break away from conventionality - but as long as they don't reproduce, they'll be gone eventually.