That's a big assumption, and I doubt it applies broadly: Many military jobs do not depend much on physical fitness: Drone pilot, mechanic, truck driver, radar operator. Front line service is only one small part.
Also, it omits the point that less-than-physically-fit can understand the risks, made their own decisions, and also improve their fitness.
Imagine drafting people with physical handicaps - that would be the equivalent of McNamara's horrible program.
I honestly have no idea how this thought leads to the conclusion that we need to lower the physical standards for military services, rather than simply disallow any woman who can’t meet them from serving in a combat role. We shouldn’t relax the standards to make it easier for women to join, we should be holding women to the exact same standard as anyone else.
If an individual can’t sling a wounded soldier over their shoulder and carry him, why are we allowing these people to enlist at all, regardless of sex? You can’t start accepting blind people into combat roles just to meet diversity quotas. If you can’t meet the basic standards of sight, you can’t enlist. If you can’t meet the basic physical standards, you can’t enlist. That just makes sense.