News for hackers. Stuff that matters.
Re:Solving Verbal Questions in IQ Test by Knowledge-Powered ... by huac on Saturday June 13, 2015 @12:43AM (#9709901)
How reliable is MTurk for an IQ test? I presume the respondents don't put in that much effort on these quizzes.
Re:Solving Verbal Questions in IQ Test by Knowledge-Powered ... by compbio on Saturday June 13, 2015 @04:10AM (#9710304)
MTurk is representative of the human population. I hear it often that people presume that MTurkers do not put in any effort for a few cents. But for most it is a hobby/nice pastime. They do it to make a few bucks, instead of playing chess or reading a book. Most people do not get a nickel playing chess, though really put in the effort. MTurkers are similar.

See here for an MIT experiment in blurry text transcription: http://groups.csail.mit.edu/uid/deneme/?p=329 for the unexpected accuracy resulting from crowd-sourcing.