This is setting up a false dichotomy. Women (and men) generally don't find an inflated look attractive.
The parent was talking more about strength, rather than muscle volume "I'm not nearly at peak muscle volume nor do I look nearly as big as body builders much smaller than me".
I'm 150 pounds, but I can lift 250. I look strong, sure, but I'm even stronger than I look. I do barbell training, which I'm guessing is what the original comment's author does too.
Women seem to find this lean strength primally attractive. It's true the female attention could cause a problem, but this kind of strength will also make you more attractive to your partner, which is hardly a bad thing.
Strength is versatile too. I can hike a mountain, ski, run, and do pretty much any physical activity you can name. Chronic pain disappeared too. I'm sure I'd lose a bit of strength on a three week trip, but who cares? You can always get that back.
I can't comment on high altitude performance, but it sounds like you're referring to the inflated types there too.
With regards to fitness, I definitely agree that I prefer a practical definition of fitness level. I may not look gigantic compared to some of the guys in the gym, but I can both lift a lot of weight, run fast sprints and long distance runs. Its that type of fitness that is great for rugby.
Even if you ignore the muscle building, it can help with recovery which leads to being able to recover from harder (endurance) training sessions.
That's often the reason that endurance cyclists use it (illegally of course).
See http://www.outsideonline.com/fitness/Drug-Test.html for a amateur cyclist and journalist who took testosterone (along with HGH and EPO) to see what it would do.
as for strength - I find it much better to have real world-usable one, combined with endurance. Examples you describe are OK, but better use cases for me are - being able to climb that mountain (or just hike it), full day of of-piste skiing (its damn hard on quads) etc. In many sports, too much muscles has negative impact. For high altitude, common knowledge is that gym type muscular types struggle more up there. For climbing same. But that's me. It also brings freedom in eating - keeping huge amount of muscles while doing some 3-week effort on Aconcagua... not really possible.