Re:WSJ: "India Graduates Millions But Too Few Are Fit to Hir...
by sethg on Wednesday April 06, 2011 @10:09AM
(#2415113)
I don’t think I am misremembering and I don’t think I was part of a study. This would have been around 1980, so the test was probably the WISC-R, which was published in 1974; maybe they got better about eliminating loaded questions in the WISC-III (which wasn’t published until 1991).
When I Google “who discovered america? wisc-r” I get several hits mentioning this test question.
Re:WSJ: "India Graduates Millions But Too Few Are Fit to Hir...
by yummyfajitas on Wednesday April 06, 2011 @11:17AM
(#2415405)
Upon further googling, you seem to be correct. Apparently the people designing WISC-R never bothered to read up on the theory of intelligence.
This isn't even a new idea - it dates back to the original Spearman paper from 1904. Start reading on page 65.
Re:WSJ: "India Graduates Millions But Too Few Are Fit to Hir...
by jbooth on Wednesday April 06, 2011 @12:13PM
(#2415678)
Not to mention that the answer which gives you more points of IQ, hence meaning you're "smarter", isn't even correct. You can start with the native americans, go through to the vikings, and I read a book recently that made a very convincing case that the Chinese sailed to South America in 1421-1423 before they shut themselves off from the world for 400 years.
Re:WSJ: "India Graduates Millions But Too Few Are Fit to Hir...
by metageek on Wednesday April 06, 2011 @10:31AM
(#2415193)
>This is unbiased because all information is given.
In this case, though, it is biased because some people will have heard the puzzle before, and having heard it before is tied to culture rather than to intelligence.
Re:WSJ: "India Graduates Millions But Too Few Are Fit to Hir...
by yummyfajitas on Wednesday April 06, 2011 @10:55AM
(#2415306)
Very true, this is why it's important to come up with new questions each time.
Re:WSJ: "India Graduates Millions But Too Few Are Fit to Hir...
by sethg on Wednesday April 06, 2011 @12:25PM
(#2415736)
But even if you’re coming up with new questions all the time, a child who has experience solving this kind of problem will be at an advantage over a child who has never tried it.
Re:WSJ: "India Graduates Millions But Too Few Are Fit to Hir...
by chc on Wednesday April 06, 2011 @01:07PM
(#2415903)
Not only that, but questions can include a lot of implicit assumptions. One example I saw from a test was something along the lines of, "You go to a store. The sign says it's closed for lunch. It's currently 12:55, and you have an appointment at 1:30. What do you do?"
The correct answer was "Wait 10 minutes, then leave if it's not open." But people with lower incomes were disproportionately likely to say you should just walk away and come back some other time. This is because people in low-income neighborhoods have been taught that loitering in an empty lot leads to bad things.
Re:WSJ: "India Graduates Millions But Too Few Are Fit to Hir...
by yummyfajitas on Wednesday April 06, 2011 @01:08PM
(#2415908)
I don't know about IQ tests, but this is certainly not true for the SAT. SAT prep only raises scores by about 30 pts (on the old 1600 pt test), at least according to studies not funded by Kaplan.
If such a section was used on a test they described as an "IQ test", it was almost certainly there only for statistical validation purposes.
There have been a number of studies done which ask obviously knowledge based questions, obviously g-loaded questions, and unknown questions. They then compare the statistical distribution of answers to the unknown questions to the obviously bad questions ("who discovered America") and the obviously good questions ("you want to carry a fox and two goats across the river in a 2 seated boat, but if you leave the fox alone with the goat the fox eats the goat..." [1]). If you aren't misremembering, I suspect you were participating in such a study.
[1] This is unbiased because all information is given. You don't need to know what a fox or goat is, or have ever seen a boat. It could be rephrased "you want to transport a X and two Y's from location A to location B. But if you leave an X and a Y alone, you fail."