2. If n is very small in a several-year period, you wouldn't be able to do meaningful analyses on that period. How many women CEO's were there in the Fortune 1000 in the 80's? 90's? I'm going to guess epsilonically few.
3. Possible explanation that isn't hand-waving: selection bias, somewhat akin to the immigration effect. Because it's more challenging for women to get on a career path that eventually leads them to become a CEO, only the most determined/resourceful/hardworking will get there and be measured in the sample, whereas fewer men get weeded out. (e.g., IQ scores of H1B recipients from Asia is not representative of Asia as a continent, where IQ is a standin for whatever measurable trait you want here; and overall Asia and North America may well be quite comparable along most dimensions.)
As to your explanation 3: that's just the kind of thing people want to believe who cherish such studies. At the same time there were also women who failed as CEOs (as the article said). Sure, it's a valid hypothesis, but there would be many ways to test it. For starters, there must already be studies correlating IQ to CEO success. What do they say?
Now it seems rather curious to me that they choose 2004-2008 for their comparison (in the first paper you linked to). So strangely, they catch exactly that crash point in their interval.
It's always the same shenanigans...
Edit: But it sounds like it actually was due to the size of the dataset: https://news.ycombinator.com/item?id=9222416
Also, what percentage of companies in the S&P 500 where ran by women? I didn't see that anywhere.
Why choose all companies with female CEOs from the S&P 1000? The S&P 500 as of last year had 26 female CEOs, and if I had to guess, I'd say that number is higher than it would have been in 2002. The portfolio of "S&P 500 companies with female CEOs as of 2002" wouldn't have been diversified enough to reliably converge to the "market return of companies with female CEOs" that they were trying to investigate.
This is a great point. Anytime you see a study where the time period seems contrived, it's usually because it was used to tweak the outcome to get what the author wanted.
Never invest in the stock market!!! (Source: S&P500 from Jan 02 to Jan 08)
What does it look like?
Only skimmed it, but they have for example a chart for 2005 to 2011. Between 2005 and mid 2007the zero-women companies outperform the at-least-one-women companies, then there is some sort of crash and the roles reverse. Would be curious to see the chart for pre-2005...
Results like that are generally bunk, or if they really cared, they would have made a broader statement (in these and those periods they performed like that).
I have only looked at the Credit Suisse paper that I think started this meme, and they clearly use a cut off point that makes women led companies look good. If they start their comparison a couple of years earlier, suddenly it looks different.
That's just standard methodology for companies like Credit Suisse whose main business is convincing people to buy stock. That same method is used to make stock market funds look good all the time (so that gullible people pay the 5% premium for the seemingly brilliant manager of that fund).
Other explanations of course could be: categories of businesses were trending that were more attractive to women (like digital services vs mining or something like that). Or the market in the time favored a risk averse approach and women tend to be more risk averse (don't know that) - there was a bad economical recession in that period of time (as they claim women "manage risk better" - well there are times when more or less risk taking are called for).
Don't get me wrong, I don't mind if women are CEOs and lead companies. I'm just wary of "narratives" that sound too good or too ideologically motivated.