If there was one, there was at least a ton of exceptions to the rule, male and female.
EDIT: Though I didn't work with any generals. There are only several hundred U.S. generals, and that number is capped.
That would be gender-blind but also ignores the fact that absolute scale actually matters in war sometimes - running speed, ability to lift and load heavy tank shells for a few hours etc.
One might argue that actual physical strength doesn't matter much. One way to check this claim would be to look at recently granted medals for valor, and see how many of them are related to absolute (not relative) physical prowess.
Indeed, the higher up you go, the more your job becomes about leading and the less it becomes about individual feats of strength. I think you're thinking about the military a little bit wrong here -- this isn't the Roman era (when centurions led from the front and had to be legitimate physical badasses). Being higher up in the military nowadays is a lot more akin to being a paper pusher director at a company.
Medical and fitness are different things. Lots of people can pass the fitness tests but still flunk out for medical reasons. Diabetics. People who get cancer. Failing eyesight. Sever allergies. It is very possible to ace the fitness tests while still failing the medical.
Compare Canada where, beyond not having photos, even gender-based pronouns have been removed from performance reports in order that reviewers not risk gender bias.