This is exactly the problem. Since running naturally normalizes for body weight, going by your "stronger and larger", we would expect men to be significantly slower. At any endurance event, starting at a mile. But the evidence isn't there.