Yes, until reliably accessible contraception fertility was driven by the desire to have sex.
> If it were true fertility rates could not possibly have dropped so far in so few generations after modern medicine and the insane reduction in violent death rates seen in the last thousand years.
This assumes no change in the environment, when it has manifestly changed. In this new environment in which desire to have children leads to having more children, on average, the desire to have more children will be selected for.
Probably.
But although it is almost tautological that fertility is heritable, it doesn't follow that the first world infertility trend will reverse.
If whatever is causing first world infertility (1) actually profits from our infertility and (2) is some kind of evolving entity itself, we could find ourselves in an evolutionary arms race, and lose.
The replacement fertility rate to maintain population before modern medicine could be closer to ten than two not so long ago.
War, famine, disease, accidents, and infant mortality made it so surviving until you were old enough to start having your own children was rare and women were often pregnant or nursing continuously as long as they were fertile.
The premise of heritable fertility driving population and reproduction rates in humans is really far off. We're not having litters of kittens.
If it were true fertility rates could not possibly have dropped so far in so few generations after modern medicine and the insane reduction in violent death rates seen in the last thousand years.