But in an environment where that doesn't matter anymore, it's only natural that sperm "health" will consequently deterioriate. Natural selection doesn't select for "the best", it only selects for "good enough". And if "unhealthy" sperm that can't move sufficently is "good enough", well so be it. Especially if we take factors like in-vitro and artificial insemination into account, those really remove the "health" of sperm from the equation of pregnancy.
I agree that in-vitro and artificial insemination could remove an important feedback mechanism for sperm evolution, and that would be a cause for worry.
Which by itself is fine, really. Sperm that fails to reach an egg means the genes that made that sperm do not "deserve" to reproduce. However, if people want to make a fuss over low birth rates, and this is one factor behind it, it's going to get attention.
This has everything to do with monogamous relationships and marriages in most of the developed human world.
In the natural world, there are many factors at play that help ensure only the "healthiest" males conceive with females. Most factors are indirect, such as males physically fighting each other for a mate wherein the "fittest" male would more likely come out superior and successfully mate.
One direct factor that has been practically eradicated from humanity, however, is direct competition between sperm. Some animals and many plants are polygamous, wherein a female receives sperm (or other forms of genetic material as applicable) from multiple males. The sperm have to compete with each other to reach the egg first and conceive, this encourages males with the "healthiest" sperm to pass their genetic material onto the next generation.
Monogamous relationships and marriages as seen in humans remove this factor completely, the "fitness" of a given male human's sperm is irrelevant to conception because competition between sperm has ceased to exist. Both unfit and fit sperm alike can conceive, assuming other indirect factors at play allow for it. Indirect factors that care not for the "fitness" of sperm.