News for hackers. Stuff that matters.
Re:How Not to Explain Success by eli on Sunday May 29, 2016 @09:34PM (#11799090)
I'm not a social scientist, but online polls have been widely used and accepted for years. All forms of polling have bias and these can be adjusted for.

Internet-only polls fared well in 538's analysis of 2012 election polling: http://fivethirtyeight.blogs.nytimes.com/2012/11/10/which-po...

Re:How Not to Explain Success by throwawayrol on Sunday May 29, 2016 @11:06PM (#11799341)
Internet polls are significantly different from Amazon turk; see my sibling post. Internet polling isn't nearly as problematic, especially for a study like this.

crowd-sourcing platforms need their own bias adjustments and I'm not even convinced that it's possible to adjust for the bias caused by using these platforms, unless you really are interested in putting a lower bound on human ability. Not a statement about the quality of people on Turk, just the amount of effort they often (rightfully!) put into below-developed-world-minimum-wage work...