News for hackers. Stuff that matters.
Re:Correlation implies Causation (2009) by xyience on Monday May 02, 2016 @04:10PM (#11615120)
Simpler article (with a proof): http://oyhus.no/CorrelationAndCausation.html

Edit: also regarding the last sentence, "...because all we have to help us establish causal relationships is correlation". The work of Pearl et al. give us quite a bit more: http://www.michaelnielsen.org/ddi/if-correlation-doesnt-impl...

Re:Correlation implies Causation (2009) by infinity0 on Monday May 02, 2016 @04:33PM (#11615335)
I think the point of "correlation does not imply causation", refers to the literal prepositional logic sense of "=>".

Yes, correlation suggests causation, i.e. P(causation|correlation) > P(causation) from a Bayes perspective. That doesn't mean you should discount the possibility of ¬causation, merely that its probability is smaller. And "how much smaller" could be very close to 0, so it would still be hasty to say "implies", which linguistically implies "=>".

A better phrasing would be "correlation suggests but does not imply causation". (edit: e.g. as per that xkcd comic, mentioned by other posters. edit2: I mixed up the proof with the OP article. the proof uses "evidence of" which is also good.)

But yes, nice proof nonetheless. I like how causation is basically defined as P(c|a) = 1, showing how most complex philosophical issues are actually irrelevant (for this particular result).

Re:Correlation implies Causation (2009) by dragonwriter on Monday May 02, 2016 @04:36PM (#11615360)
Actually, as I see it, the main point of "correlation does not imply causation" is mostly "correlation does not imply a particular causal relationship". While coincidence is possible, as well, its mostly about the fact that you can't conclude A causes B from a correlation between A and B alone, because the correlation may be due to the fact that B causes A, or the fact that A and B are both caused by C. That's why you need the correlation, plus an explanatory theory of the causation, plus evidence to reject alternative causal relationships, to have a decently strong basis for concluding a particular causal relationship.
Re:Correlation implies Causation (2009) by infinity0 on Monday May 02, 2016 @04:43PM (#11615421)
I think, what I said is the same as what you said, just with some more maths.

> you can't conclude A causes B

right, this is what I referred to as "=>"

> plus an explanatory theory of the causation, plus evidence

yes, this all works together to build up the "how much smaller". An explanatory theory basically allows you to make predictions and run tests to collect more data to pump into the application of Bayes' theorem as used by that proof, improving your confidence of the difference between P(a|c) and P(a).

Re:Correlation implies Causation (2009) by jsprogrammer on Monday May 02, 2016 @05:27PM (#11615809)
Belief in "correlation implies causation" admits the Law of Excluded Middle fallacy.

Just because you make an observation consistent with your beliefs, does not mean that you can claim all other explanations (complement of your beliefs) are invalid (primarily because you do not know what they are or could be).

Re:Correlation implies Causation (2009) by JadeNB on Monday May 02, 2016 @11:32PM (#11617700)
> > you can't conclude A causes B

> right, this is what I referred to as "=>"

Except that it isn't quite, since you were careful to clarify that your \implies (i.e., '=>' or '⇒') was the \implies of propositional logic, which explicitly disclaims any causal relationship. \implies in that context says precisely and only that the antecedent is false, or the consequent is true. In this sense, 2 + 2 = 4 \implies Barack Obama is currently the president of the US, and 2 + 2 = 5 \implies George Bush is currently the president of the US, even though there is no causal relationship in either case.

Re:Correlation implies Causation (2009) by infinity0 on Tuesday May 03, 2016 @04:47AM (#11618931)
"is" in language can often mean "is a subset of", I was using the term that way. Whilst you are right that "=>" disclaims any philosophical relationship, the proof covers all definitions of "cause" that one might reasonably come up with. So "you can't conclude A => B" implies (with probability 1) that "you can't conclude A causes B":

The proof only defines "causation" as some event "a" for which "P(c|a) = 1". This is the same property that "=>" has in propositional logic, and there is no implication of philosophical causation here either. But the proof still works, as a consequence of its definitions.

So in other words, the proof says: if causation causes correlation then P(a|c) > P(a) (i.e. correlation is evidence of causation) but we can't say causation is definitely true (P(a) = 1), however you want to define "causes" as long as it has the property that P(c|a) = 1.

Re:Correlation implies Causation (2009) by dragonwriter on Tuesday May 03, 2016 @09:40AM (#11620502)
That's not entirely true, at least, using the normal definition of "causes" that is of interest in correlation vs. causation discussions, which certainly includes "causes" which are contributors to the occurrence of an effect but do not alone guarantee it (e.g., smoking causes cancer, but it is not true that smoking implies cancer in the propositional logic sense.)
Re:Correlation implies Causation (2009) by tmoertel on Monday May 02, 2016 @07:06PM (#11616486)
There are additional possible causal stories, as well. It could be that A and B are completely independent but both causes of C, and your observations of A and B are gated by C. Most people aren't aware of this possibile explanation.
Re:Correlation implies Causation (2009) by jerf on Monday May 02, 2016 @07:02PM (#11616450)
Shorter: Correlation does not Aristotelian-imply causation. Correlation probabilistically-implies causation.

Aristotelian logic is a necessary step towards understanding logic, but on its own it's not actually that useful because in reality we just don't have enough things that we can safely approximate as 100% true for it to work reliably.

Incidentally, this also means that the classic lists of "argument fallacies" often contain a few fallacies themselves, as an argument being Aristotelian-fallacious does not mean that it's practically- or probabilistically-fallacious. But I will agree that this is generally a distinction without a difference; I only rarely see someone accuse someone else of committing a fallacy where the accusation is Aristotelian-correct but not probabilistically-correct. But, rolling back around to the original point, most of them are indeed thoughtless recitations of the "correlation does not imply causation" mantra when, probabilistically, the correlation being observed can be reasonably interpreted as evidence.

Re:Correlation implies Causation (2009) by xiler on Monday May 02, 2016 @06:18PM (#11616171)
I'm no expert on this subject but the proof in the first article seems a bit dodgy. Bayesian inference is a type of induction [1]. So using it to prove induction merely begs the question?

[1] http://plato.stanford.edu/entries/induction-problem/#BaySub

Re:Correlation implies Causation (2009) by dustintran on Monday May 02, 2016 @06:43PM (#11616342)
The author doesn't really apply Bayesian inference. He applies Bayes' rule which is a mathematical property.
Re:Correlation implies Causation (2009) by mhermher on Monday May 02, 2016 @05:37PM (#11615894)
P(c|a) is not 1. If we assume correlation is Pearson, then the "shape" of the causation has to be a linear effect for P(c|a) = 1. A U-shaped effect will probably give you a Pearson 0, etc.

I do love the work of Pearl, et. al. But even they do not admit Pearson (or any other type) of correlation, but rather the nebulous "statistical dependence". So the proof only works if your statistical dependence tool of choice matches the nature of your causal effect perfectly.

Re:Correlation implies Causation (2009) by xtacy on Monday May 02, 2016 @05:50PM (#11615975)
> But even they do not admit Pearson (or any other type) of correlation, but rather the nebulous "statistical dependence".

The notion of "Statistical dependence" is not nebulous. X and Y are independent if the joint distribution factorises as

    p(X, Y) = p(X) p(Y)
> even they do not admit Pearson (or any other type) of correlation,

Precisely. They operate purely in probabilistic dependence/independence terminology, from a theoretical point of view.

Re:Correlation implies Causation (2009) by mhermher on Monday May 02, 2016 @05:56PM (#11616025)
I understand, but from an inference point of view, it is nebulous because the distributions are unknown. Statistical dependence can be determined easily if you know the distributions, but not if you only have samples.

The "c" in the proof, I assume means "observed correlation". Because we are in fact talking about "[Observed] correlation does not imply [Unobserved] causation", right?

Re:Correlation implies Causation (2009) by xtacy on Monday May 02, 2016 @08:02PM (#11616830)
I partly agree with you, but I wouldn't go to the extent of using "easily" in this phrase --

> Statistical dependence can be determined easily if you know the distributions,

Even if you know the distribution, a statistical test will make Type-I/II errors that you would have to take care of.

Actually, I find the text linked above hard to understand, without properly defining 'c.' What's the sample space?

In general, my sentiments are with the xkcd comic strip, but nothing more. Pearl's theories lay a firm foundation for communicating a causal hypothesis and manipulating it algebraically, but the true tests of causal hypothesis are:

- Experimental evidence

- The predictions it makes, in cases where experiments are hard to perform (e.g., in physics, when we make certain causal conjectures about how the universe works).