Re:How Not to Explain Success
by throwawayrol on Sunday May 29, 2016 @11:06PM
(#11799341)
Internet polls are significantly different from Amazon turk; see my sibling post. Internet polling isn't nearly as problematic, especially for a study like this.
crowd-sourcing platforms need their own bias adjustments and I'm not even convinced that it's possible to adjust for the bias caused by using these platforms, unless you really are interested in putting a lower bound on human ability. Not a statement about the quality of people on Turk, just the amount of effort they often (rightfully!) put into below-developed-world-minimum-wage work...
Internet-only polls fared well in 538's analysis of 2012 election polling: http://fivethirtyeight.blogs.nytimes.com/2012/11/10/which-po...