News for hackers. Stuff that matters.
Re:Mapping OKCupid answer data: rape fantasies and hygiene b... by snewe on Friday June 26, 2009 @02:25PM (#675827)
The article makes some strong claims about the statistical validity of their results. However, 1,000,000 observations is not always better than 3,000 observations. If the data are not representative, then a Gallup poll (which is) of a order of magnitude smaller sample is much more powerful.
Re:Mapping OKCupid answer data: rape fantasies and hygiene b... by shalmanese on Friday June 26, 2009 @02:39PM (#675861)
Counterintuitively, if the sample is truly randomly distributed, you gain very little additional information as you go beyond 300 samples. This is why every political poll has an error margin of + or - 3%.
Re:Mapping OKCupid answer data: rape fantasies and hygiene b... by jules on Saturday June 27, 2009 @05:46AM (#676747)
Right, but that doesn't mean that 300 (or 3000) samples total is enough. You can't make the detailed map about burning the national flag with 3000 samples. More data is helpful until you have 300 samples per pixel.
Re:Mapping OKCupid answer data: rape fantasies and hygiene b... by Retric on Friday June 26, 2009 @07:56PM (#676392)
The real problem is most samples are not random. So, you are bound by the bias of your methods and you can't really get all that accurate. In theory when you double your sample size you do reduce your margin of error by a reasonable degree, but reality does not mesh until you start taking a large percentage of the population.

Think of it like a coin, that has a 1% bias you want the percentage to some accuracy (say 4 digits) how many flips do you need?. Now what if the problem is not the coin but the person doing the flipping. At some point more testers help more than more flips.

Re:Mapping OKCupid answer data: rape fantasies and hygiene b... by Eliezer on Friday June 26, 2009 @07:53PM (#676386)
Glad someone pointed this out.
Re:Mapping OKCupid answer data: rape fantasies and hygiene b... by jimboyoungblood on Friday June 26, 2009 @02:40PM (#675866)
The claim it makes is this:

And a word about statistical validity: the best questions on OkCupid have been answered over a million times. Therefore we have unique insights into the American mindset

Yeah, so OKCupid users aren't representative of the average American, but somehow I don't think a post titled "Rape Fantasies and Hygiene By State" is meant to be a serious exercise in statistics.

Re:Mapping OKCupid answer data: rape fantasies and hygiene b... by jrockway on Friday June 26, 2009 @04:27PM (#676049)
Why not? Are sex and (not) bathing somehow different from other topics in a way that is relevant mathematically?
Re:Mapping OKCupid answer data: rape fantasies and hygiene b... by byrneseyeview on Friday June 26, 2009 @05:34PM (#676174)
The way the post is marketed indicates that it's entertainment, not analysis.
Re:Mapping OKCupid answer data: rape fantasies and hygiene b... by cabalamat on Saturday June 27, 2009 @11:26AM (#676914)
Can't it be both?
Re:Mapping OKCupid answer data: rape fantasies and hygiene b... by DannoHung on Friday June 26, 2009 @02:32PM (#675847)
Whether or not the data is statistically valid across the general populace may or may not be relevant to people who are concerned with the sample that is represented.
Re:Mapping OKCupid answer data: rape fantasies and hygiene b... by hamidp on Friday June 26, 2009 @05:17PM (#676149)
Arguing that OKC data is better than Gallup's (as the article implies) isn't a strong claim of statistical validity, it's ignorance of the basic principles of statistics.
Re:Mapping OKCupid answer data: rape fantasies and hygiene b... by pfedor on Friday June 26, 2009 @11:52PM (#676579)
It's more likely a joke. The guy has a mathematics degree from Harvard. http://www.okcupid.com/about-us/