News for hackers. Stuff that matters.
Re:Mapping OKCupid answer data: rape fantasies and hygiene b... by snewe on Friday June 26, 2009 @02:25PM (#675827)
The article makes some strong claims about the statistical validity of their results. However, 1,000,000 observations is not always better than 3,000 observations. If the data are not representative, then a Gallup poll (which is) of a order of magnitude smaller sample is much more powerful.
Re:Mapping OKCupid answer data: rape fantasies and hygiene b... by shalmanese on Friday June 26, 2009 @02:39PM (#675861)
Counterintuitively, if the sample is truly randomly distributed, you gain very little additional information as you go beyond 300 samples. This is why every political poll has an error margin of + or - 3%.
Re:Mapping OKCupid answer data: rape fantasies and hygiene b... by jules on Saturday June 27, 2009 @05:46AM (#676747)
Right, but that doesn't mean that 300 (or 3000) samples total is enough. You can't make the detailed map about burning the national flag with 3000 samples. More data is helpful until you have 300 samples per pixel.
Re:Mapping OKCupid answer data: rape fantasies and hygiene b... by Retric on Friday June 26, 2009 @07:56PM (#676392)
The real problem is most samples are not random. So, you are bound by the bias of your methods and you can't really get all that accurate. In theory when you double your sample size you do reduce your margin of error by a reasonable degree, but reality does not mesh until you start taking a large percentage of the population.

Think of it like a coin, that has a 1% bias you want the percentage to some accuracy (say 4 digits) how many flips do you need?. Now what if the problem is not the coin but the person doing the flipping. At some point more testers help more than more flips.

Re:Mapping OKCupid answer data: rape fantasies and hygiene b... by Eliezer on Friday June 26, 2009 @07:53PM (#676386)
Glad someone pointed this out.
Re:Mapping OKCupid answer data: rape fantasies and hygiene b... by jimboyoungblood on Friday June 26, 2009 @02:40PM (#675866)
The claim it makes is this:

And a word about statistical validity: the best questions on OkCupid have been answered over a million times. Therefore we have unique insights into the American mindset

Yeah, so OKCupid users aren't representative of the average American, but somehow I don't think a post titled "Rape Fantasies and Hygiene By State" is meant to be a serious exercise in statistics.

Re:Mapping OKCupid answer data: rape fantasies and hygiene b... by jrockway on Friday June 26, 2009 @04:27PM (#676049)
Why not? Are sex and (not) bathing somehow different from other topics in a way that is relevant mathematically?
Re:Mapping OKCupid answer data: rape fantasies and hygiene b... by byrneseyeview on Friday June 26, 2009 @05:34PM (#676174)
The way the post is marketed indicates that it's entertainment, not analysis.
Re:Mapping OKCupid answer data: rape fantasies and hygiene b... by cabalamat on Saturday June 27, 2009 @11:26AM (#676914)
Can't it be both?
Re:Mapping OKCupid answer data: rape fantasies and hygiene b... by DannoHung on Friday June 26, 2009 @02:32PM (#675847)
Whether or not the data is statistically valid across the general populace may or may not be relevant to people who are concerned with the sample that is represented.
Re:Mapping OKCupid answer data: rape fantasies and hygiene b... by hamidp on Friday June 26, 2009 @05:17PM (#676149)
Arguing that OKC data is better than Gallup's (as the article implies) isn't a strong claim of statistical validity, it's ignorance of the basic principles of statistics.
Re:Mapping OKCupid answer data: rape fantasies and hygiene b... by pfedor on Friday June 26, 2009 @11:52PM (#676579)
It's more likely a joke. The guy has a mathematics degree from Harvard. http://www.okcupid.com/about-us/
Re:Mapping OKCupid answer data: rape fantasies and hygiene b... by viggity on Friday June 26, 2009 @05:44PM (#676201)
Selection Bias much?

Volunteer polling is about as un-scientific as you can get. Did it not occur to them that people who are willing to answer poll questions about sex are probably going to have different opinions about sex than someone who isn't willing to seek out the poll?

Re:Mapping OKCupid answer data: rape fantasies and hygiene b... by thomaspaine on Saturday June 27, 2009 @01:47AM (#676638)
Selection bias doesn't explain the inter-state difference, which is what the visualizations are attempting to display.

For that to be an issue here, you'd have to argue that there's something about living in Nevada as opposed to New York, independent of your attitude towards sex, that would affect whether or not after seeing this question, you chose to answer or pass.

Re:Mapping OKCupid answer data: rape fantasies and hygiene b... by swombat on Saturday June 27, 2009 @05:56AM (#676758)
Perhaps not, but ratios of males and females might explain most of the differences between east and west.
Re:Mapping OKCupid answer data: rape fantasies and hygiene b... by mynameishere on Friday June 26, 2009 @11:08PM (#676545)
Re: Showering.

I have this tragedy-of-the-commons thing going on with the other tenants in the building. The water is "included" in the rent and so I sometimes shower 3, 4 times a day for the hell of it. I've seriously considered heating the place by running the shower nonstop in winter, but someone would probably catch on.

Right out of college, dirt poor, I had a place alone, and would turn the water heater on 45 minutes before I'd shower, then turn it off again.

Re:Mapping OKCupid answer data: rape fantasies and hygiene b... by newaccount1 on Saturday June 27, 2009 @04:15AM (#676718)
I had a similar situation. During a heat wave I filled up the bathtub and sinks with cold water to absorb some of the heat. A few days later they sent someone to check for water leaks in my apartment =).
Re:Mapping OKCupid answer data: rape fantasies and hygiene b... by Dilpil on Saturday June 27, 2009 @01:55PM (#677008)
I'm not sure that is actually such an inefficient method of cooling your place- water is after all, famous for its high heat capacity.
Re:Mapping OKCupid answer data: rape fantasies and hygiene b... by jrockway on Friday June 26, 2009 @04:29PM (#676055)
Wow, it scares me that anyone thinks flag burning should be illegal.
Re:Mapping OKCupid answer data: rape fantasies and hygiene b... by Kadin on Friday June 26, 2009 @07:25PM (#676340)
The interesting thing is that almost everyone believes that flag burning ought to be totally legal; the argument is just over the circumstances.

As is routinely pointed out, burning a flag is the approved way of "retiring" one when it's no longer fit to be flown. If you fly a flag every day, this will be about once a year or so. In my area, the American Legion or Boy Scouts do "flag retirements" as a fund raiser once in a while; you turn in your old flags and they respectfully burn them. (Maybe they play Taps at the same time or something.)

So the argument isn't over flag burning per se, and it never was. It's over flag defacement or "desecration," i.e. burning the flag in the context of a political demonstration, or as an overtly political act.

Re:Mapping OKCupid answer data: rape fantasies and hygiene b... by LogicHoleFlaw on Friday June 26, 2009 @08:35PM (#676434)
Technically you don't burn a flag during a retirement. It is cut into quarters first. Or at least it was when I was doing these ceremonies with the Boy Scouts.
Re:Mapping OKCupid answer data: rape fantasies and hygiene b... by physcab on Friday June 26, 2009 @02:19PM (#675821)
I have to move back to California
Re:Mapping OKCupid answer data: rape fantasies and hygiene b... by ardit33 on Friday June 26, 2009 @02:40PM (#675867)
Don't. Unless you are a gay guy, or a girl. Your numbers are against you. (a lot of guys and few girls), especially in the Bay Area. That green thing is probably a lot of guys skewing that result.

From a personal anecdote evidence, I have had much better luck in the East Coast for casual stuff.

Re:Mapping OKCupid answer data: rape fantasies and hygiene b... by menloparkbum on Friday June 26, 2009 @02:44PM (#675872)
The Bay Area is hands down the worst place I have ever lived for dating.
Re:Mapping OKCupid answer data: rape fantasies and hygiene b... by strlen on Friday June 26, 2009 @04:14PM (#676026)
It's not nearly as bad if you're willing to be open and try non-conventional ways of meeting people, e.g. online. Sites like OKCupid have many women who are either intellectually inclined themselves (i.e. "nerdy") or are looking to meet a guy who is; this way, you are much more likely to find someone who appreciates and likes you for who are you than at a sports bar or a night club (whether in Bay Area, or elsewhere).
[deleted]
Re:Mapping OKCupid answer data: rape fantasies and hygiene b... by nostrademons on Friday June 26, 2009 @04:50PM (#676100)
I think the problem here is "startup", not "Bay Area". I also worked at startups for 4 years, and there were a grand total of 5 women in them (only one of whom was unmarried, and she was the founder's niece). But that was in Boston.

Both teams I've been on at Google have been about 40% female (one was 42%; the other was 40%). My cubicle is 3 women and 4 men. Most of the social outings have been fairly well-balanced; a few have even been majority female. I lived with 2 girls in my old apartment, and I see mostly women around at my new apartment. This is all South Bay, not San Francisco.

Re:Mapping OKCupid answer data: rape fantasies and hygiene b... by abossy on Friday June 26, 2009 @08:22PM (#676415)
Really??? I need to get a job at Google, apparently. :)

I've found that the difficulty in dating in the Bay Area isn't necessarily the shortage of women, but the overwhelming majority of men. The numbers probably dictate that they're equal, but this is an disadvantageous situation when the South Bay self-selects older, wealthier men and less young, single women.

Re:Mapping OKCupid answer data: rape fantasies and hygiene b... by rend on Friday June 26, 2009 @04:34PM (#676068)
It's hard to meet women when they don't exist.

Um, girls in SF say the same thing about a lack of guys.

[deleted]
Re:Mapping OKCupid answer data: rape fantasies and hygiene b... by psyklic on Friday June 26, 2009 @05:15PM (#676145)
Realistically, if you live in a large city, you really have nothing to complain about. Farmers, people in rural areas actually do have a case to make in this respect.

From my experience, guys who can't meet girls (or the opposite) still complain no matter what city they're in, no matter how stacked the odds are for them. I think that straight guys should consider themselves lucky -- imagine if you were gay and could only date 4% of the population. Not only that, but gay guys can't even tell who else they could potentially date and who would be offended by them asking!

Re:Mapping OKCupid answer data: rape fantasies and hygiene b... by kscaldef on Friday June 26, 2009 @10:19PM (#676510)
> Not only that, but gay guys can't even tell who else they could potentially date and who would be offended by them asking!

Uh... the same is true for straight guys (and for women). The odds might be better, but not every woman wants to date a man, and not every woman (regardless of orientation) is open to being hit on at a particular moment.

Re:Mapping OKCupid answer data: rape fantasies and hygiene b... by jules on Saturday June 27, 2009 @05:56AM (#676757)
The odds are much better but I think the far more significant difference is that a man asking a woman is socially accepted whereas a man asking a man is not (in most places).
Re:Mapping OKCupid answer data: rape fantasies and hygiene b... by derwiki on Friday June 26, 2009 @08:38PM (#676437)
Given the tech-savviness of the Bay Area, I actually think how well OKCupid works out here almost makes up for the fact that it seems to be harder to meet girls in the real world here than anywhere else. Given, you won't always "spark" with someone you meet online, but if you do, at least it means you probably get along with them on a deeper level than just "you're at the bar and look cute."
Re:Mapping OKCupid answer data: rape fantasies and hygiene b... by jimboyoungblood on Friday June 26, 2009 @02:58PM (#675896)
That's why it's a great place to work on startups. Fewer distractions.
Re:Mapping OKCupid answer data: rape fantasies and hygiene b... by rw on Friday June 26, 2009 @04:15PM (#676028)
Only if you want to ignore important aspects of your life.
Re:Mapping OKCupid answer data: rape fantasies and hygiene b... by staunch on Friday June 26, 2009 @05:09PM (#676137)
Which is probably ideal if you're going to focus all your energy on doing one thing really well.
Re:Mapping OKCupid answer data: rape fantasies and hygiene b... by rw on Friday June 26, 2009 @05:28PM (#676160)
What do you need to perform at your absolute best?

I need to know that the rest of my life is taken care of. Relationships included.

Re:Mapping OKCupid answer data: rape fantasies and hygiene b... by staunch on Friday June 26, 2009 @05:38PM (#676183)
You never know that, especially with relationships.
Re:Mapping OKCupid answer data: rape fantasies and hygiene b... by rw on Friday June 26, 2009 @05:43PM (#676199)
It's pretty clear that better is better than worse.
Re:Mapping OKCupid answer data: rape fantasies and hygiene b... by msluyter on Friday June 26, 2009 @03:20PM (#675927)
Interesting. Why is that? My naive assumption would have been that SF in particular would be good for straight males.
[deleted]
Re:Mapping OKCupid answer data: rape fantasies and hygiene b... by calambrac on Friday June 26, 2009 @04:37PM (#676076)
Are you sure you're going to the right bars? I'd recommend against the ones in the Castro if you're looking to meet women :)
Re:Mapping OKCupid answer data: rape fantasies and hygiene b... by ComputerGuru on Friday June 26, 2009 @04:07PM (#676010)
I second the midwest vote. Viva Chicago! :)
Re:Mapping OKCupid answer data: rape fantasies and hygiene b... by quizbiz on Saturday June 27, 2009 @04:29PM (#677146)
I fail to understand why anyone would fantasize about anything remotely like rape.
Re:Mapping OKCupid answer data: rape fantasies and hygiene b... by sho on Sunday June 28, 2009 @04:42PM (#678069)
On the off chance that you are genuinely curious about the phenomenon, here is a good start:

http://www.psychologytoday.com/blog/brainstorm/200805/why-do...

Re:Mapping OKCupid answer data: rape fantasies and hygiene b... by quizbiz on Sunday June 28, 2009 @08:44PM (#678293)
Thank you. I was/I am.