Don't assume that there is nothing inheritable about this: "the quality of life impacts are significant and people are willing to go to considerable lengths to reduce them."
Some people just won't care very much. People like this exist in the world today.
We've found genetic influences for lots of behavioral traits, including ones related to politics and religion. (and more commonly known things like: depression, autism, intelligence, etc.)
This seems like quite a stretch: humans aren’t fruit flies, and something as complicated as reproduction is not a simple trait which overrides socialization and intelligence.
This is especially true when you look at why people aren’t having as many kids as previous generations: the quality of life impacts are significant and people are willing to go to considerable lengths to reduce them. If you have genes which make you extra horny or foil certain birth control techniques, you can switch strategies and if you don’t, your children will have a stronger incentive to do so after growing up with a cautionary example.
You can’t meaningfully reason about that complicated situation as if it were something like moth coloration.