Re:RescueTime (YC 08) Data: Are Men more Productive than Wom...
by webwright on Tuesday May 04, 2010 @10:14PM
(#1320120)
Ah, true 'nuff and totally agreed. I think it'd be super interesting to try to get a good cross-section with RescueTime. Even if we buried our users in demographic questions, we'd still have a hard time get truly representative data.
More realistically, I think it'd be interesting to correct/adjust by profession. i.e. do this same analysis for JUST software engineers, for example, to correct for the likelihood that RescueTime women probably have a different distribution among the assorted career paths.
So yes, you've adjusted for the tendency to have more men than women. But you still haven't wound up with a random sampling of people out there.
To get that you'd have to select a random set of people, ask them to participate in your study, and go from there. Which would immediately hit you with the fact that over half of the USA is functionally illiterate and therefore does not use computers very much.