I ended up not choosing an answer and reading on, as it seemed like a 'trick' type question, and indeed, I was thinking about what it had alluded to, not what the actual question was.
Notice that in the jazz playing accountant example, 92% of people answered A, E, C.
Notice now that in the gambling situation, only 65% of subjects answered 2.
92% for the "story" question, and 65% for the "hard data" question. I still look at the jazz question and read it through the cultural interpretation of A > E > C, despite it being incorrect in a strictly logical sense. That does not make my interpretation a conjunction fallacy, regardless of what the question creator intended.
This only goes to show that the conjunction fallacy has no hope of being measured accurately unless the question is completely unambiguous in subtext (meaning that it doesn't tread upon cultural aspects of language, where people fill in the blanks and read between the lines).
And even then, the dice rolling question, though devoid of cultural baggage, still might not be the best way to measure the conjunction fallacy. I know a great number of people who couldn't figure out probability to save themselves. This could have skewed the results higher or even lower, depending on what proportion of the test subjects could properly interpret probabilities. Now if this question were asked to statisticians, the results would be compelling.
Rather, bank teller becomes an irrelevant side-fact, and the focus of discussion becomes whether Linda is more likely to be part of the feminist movement given her being deeply concerned with issues of discrimination and social justice.
Human language is imprecise, and comes with assumptions based on context and culture. The people who came up with this question succumbed to the false assumption that the majority of people would interpret the wording of the question the same way they did.
Because of the flawed nature of the question an the incorrect assumptions of the test givers, this question cannot be relied upon to give any measure of the "conjunction fallacy".
(1) Linda is a bank teller.
(2) Linda is a bank teller and is active in the feminist movement.
The vast majority—roughly 85 percent—of the people they asked opted for No. 2, even though No. 2 is logically impossible. (If No. 2 is true, so is No. 1.) The human mind is so wedded to stereotypes and so distracted by vivid descriptions that it will seize upon them, even when they defy logic, rather than upon truly relevant facts."
Umm.. no. The reason 85% of people chose option #2 is because the answers were so poorly worded. They give the impression of an unspoken assumption for answer #1 that Linda is NOT active in the feminist movement.