Your theory sounds more plausible to me. I'm male and find an all-male environment incredibly competitive, toxic and tiring to myself. It's very hard to get reasonable discussions and almost always degenerates into competition.

So I can imagine that you just bail if you aren't conditioned to put up with that kind of crap.