News for hackers. Stuff that matters.
Re:Simpson's Paradox is Back by cbellet on Thursday May 01, 2014 @05:34PM (#7682826)
I don't understand how Simpson's paradox is different from missing an explanatory variable and confusing correlation vs. partial correlation.

In Wikipedia's article header chart, what I see is the projection on a plane of a 3D problem, where the 3rd dimension has been overlooked. http://en.wikipedia.org/wiki/Simpson's_paradox

In Bob vs. Alice, I see also that the night/day flight dummy wasn't accounted for hence resulting in the so-called paradox.

Re:Simpson's Paradox is Back by vbs_redlof on Thursday May 01, 2014 @08:42PM (#7683532)
It's just a special case of omitted variables with categorial variables. So instead of parameter estimates being biased up or down x amount (to the extent covariates are correlated with error terms), with Simpsons's paradox the mean effect is completely wrong due to improper grouping. This often leads to flipping signs on estimated parameters -- 'surprising' results that gets papers published.

My favourite explanation: http://vudlab.com/simpsons/

Re:Simpson's Paradox is Back by mendicantB on Thursday May 01, 2014 @06:26PM (#7683039)
You're correct. It isn't different. Simpsons paradox is actually a key indicator of a confounding variable.
Re:Simpson's Paradox is Back by baddox on Friday May 02, 2014 @02:28AM (#7684349)
The more complicated examples of Simpson's paradox tend to be important causes being ignored. But it's not always an issue of causality, like in the example of two Wikipedia contributors. That example doesn't really have a hidden cause, it's just the use of percentages where total articles is clearly the more useful metric.