News for hackers. Stuff that matters.
Re:Nate Silver confuses cause and effect, ends up defending ... by sillysaurus on Thursday December 20, 2012 @02:04PM (#4949304)
The bad models were a consequence of a fraudulent system. So by definition, the models weren't the cause of the financial crisis. Therefore the bad models were an effect, in the same way the financial crisis was an effect.

If this is true, then the author's claim (mix-up of cause and effect) must be correct.

Re:Nate Silver confuses cause and effect, ends up defending ... by cube13 on Thursday December 20, 2012 @02:22PM (#4949417)
But it's not.

She states:

>Rather, the entire industry crucially depended on the false models. Indeed they changed the data to conform with the models, which is to say it was an intentional combination of using flawed models and using irrelevant historical data (see points 64-69 here for more).

So C(corruption) directly leads to B(bad model). She does not argue that A(everything falling apart)<-C anywhere in the piece. Silver is claiming that A<-B. He is not commenting about C. So while Silver's claim may not identify the absolute root cause, the author does not actually prove that his cause and effect analysis is flawed. If anything, she has shown that it may be incomplete.

Re:Nate Silver confuses cause and effect, ends up defending ... by pdonis on Thursday December 20, 2012 @03:00PM (#4949606)
Silver isn't just claming that A<-B. He is claiming that fixing B will fix A, and that fixing B is straightforward: just use good models.

mathbabe is saying that fixing B is not straightforward, because B<-C, and fixing C is very, very difficult. Bad models exist because people have incentives to make them bad.

She's also saying, I think, that fixing B by itself won't fix A, because B is not the root cause; C is. Fixing B without fixing C just means that C will manifest itself somewhere else, and A will still happen. In other words, there are many causal routes from C to A, and fixing B by itself only blocks one of them. So A<-C is true regardless of the state of B.

Re:Nate Silver confuses cause and effect, ends up defending ... by sillysaurus on Thursday December 20, 2012 @02:29PM (#4949454)
But it's not [true].

What, specifically, isn't true?

So C(corruption) directly leads to B(bad model). She does not argue that A(everything falling apart)<-C anywhere in the piece.

The point of the piece is that the financial meltdown stemmed from corruption, not from models. If this wasn't her point, then why else would she have written this piece?

Re:Nate Silver confuses cause and effect, ends up defending ... by chc on Thursday December 20, 2012 @02:44PM (#4949525)
She wrote this piece because she thinks he's only citing the proximate cause and not the ultimate cause. At least that's how it reads to me.

She doesn't appear to be disputing the idea that following bad models caused the crisis — instead, she just seems to be saying Silver missed the fact that the models were deliberately bad rather than simply a poor application of math.

A few quotes from the author herself:

"the entire industry crucially depended on the false models."

"Silver gives four examples what he considers to be failed models at the end of his first chapter, all related to economics and finance. But each example is actually a success (for the insiders) if you look at a slightly larger picture and understand the incentives inside the system."

She's not disputing that the models were false or even that acting in accordance with the models is what caused the crisis. She's disputing that this was accidental.

Re:Nate Silver confuses cause and effect, ends up defending ... by Symmetry on Thursday December 20, 2012 @03:57PM (#4949936)
What, specifically, isn't true?

An argument doesn't have to contain a false statement to have no baring on the discussion.

And more generally it's quite possible for a thing to have multiple causes, and in this universe this is generally true for everything we witness. So if A causes C that doesn't mean that B can't also cause C "by definition". I'm not aware of any serious philosphical framework that says that events must have only a single cause, though many philosophers from Aristotle onwards[1] but great stock in the "final cause" of things, but that would be either "God" or "The Big Bang" depending on your religion or lack thereof and nobody was arguing for those.

And as an aside, the words "by definition" in an argument that isn't on it's surface about definitions is generally a bit of a red flag.[2]

[1]http://en.wikipedia.org/wiki/Teleology [2]http://lesswrong.com/lw/nz/arguing_by_definition/

Re:Nate Silver confuses cause and effect, ends up defending ... by cube13 on Thursday December 20, 2012 @02:37PM (#4949494)
She does not prove that claim, though. She argues that corruption causes bad models. For Silver's cause and effect analysis to be incorrect, she needed to prove that the inaccurate models had absolutely nothing to do with the financial meltdown.
Re:Nate Silver confuses cause and effect, ends up defending ... by btilly on Thursday December 20, 2012 @03:34PM (#4949794)
The models can be part of the meltdown without really being a cause.

If I choose to shoot you with a gun, and have a variety of appropriate guns, it is not the fault of the specific gun chosen that it was used to kill you. I had motive, opportunity, and alternate means available.

Re:Nate Silver confuses cause and effect, ends up defending ... by freyr on Thursday December 20, 2012 @03:39PM (#4949820)
"For Silver's cause and effect analysis to be incorrect, she needed to prove that the inaccurate models had absolutely nothing to do with the financial meltdown."

If I smashed your head in with a hammer, would people claim the hammer was the cause of your death? Is "hammer caused death" the end of the story, or even particularly important to the related series of causes and effects?

She's arguing that it's not, that Silver's cause and effect analysis is irrelevant because his purported cause is purely incidental. Intentionally inaccurate models were simply an instrument designed to further the self-interest of individuals.

(And further, she doesn't need to provide a "proof" to make this claim. But she does offer a compelling argument.)

Re:Nate Silver confuses cause and effect, ends up defending ... by martinced on Thursday December 20, 2012 @03:46PM (#4949861)
A is the "financial crisis", not "everything falling apart".

Everything falling apart would be hyper-inflation in addition to capital control and gold confiscation : )

That could be 'D'.

Latter or sooner we'll learn if D <- A ; )

Re:Nate Silver confuses cause and effect, ends up defending ... by Alex3917 on Thursday December 20, 2012 @02:22PM (#4949413)
The easiest way to understand this is that even if the models were accurate, the financial crisis would still have occurred. So blaming the models would be confusing cause and effect regardless of whether you think the models were wrong intentionally or unintentionally.

That said, I didn't read the book so I have nothing to say about whether or not Nate Silver actually does this.

Re:Nate Silver confuses cause and effect, ends up defending ... by mbucc on Thursday December 20, 2012 @03:08PM (#4949661)
The models certainly contributed. (Note: I have read this far in the book.)

The modeling error in question was independence; that is, if you have five mortgages, each with a 5% change of default, then these can be packaged up as an AAA security as follows: you only lose your money if all five default. A bit riskier package is that you lose if 4/5 default. And so on, each with different returns.

If they are independent, the p(default) = 1/20^5. If they are dependent, it is 1/20. Now multiple mortgage pool size by a 100 or 1,000 or 10,000 (?) and see how far off the estimated risk is. :)

Now combine this with a 30-to-1 leverage when buying these "AAA" securities.

(This was quite a good problem to work through with my daughter to see what that little "independence" assumption means. :)

His main point here was that modeling failures are typically due to out-of-sample conditions; when the housing bubble broke, the markets were might more tightly coupled across the country than the modelers assumed. While they could have seen this kind of dependence if they looked to Japan, there was no such precedence in the US in recent history.

Re:Nate Silver confuses cause and effect, ends up defending ... by jeltz on Friday December 21, 2012 @07:31AM (#4952458)
This is a beginner mistake which I have a hard time believing the entire mortgage market failed to spot.

My personal belief is that they knew of the flaw of the models but did not care since their personal incentives were more profitable if the model was not fixed.

Re:Nate Silver confuses cause and effect, ends up defending ... by hindsightbias on Friday December 21, 2012 @01:24PM (#4953824)
As Michael Lewis found in the Big Short. His Liar's Poker (from the 80's) explains the mentality. As he says in the former, he thought the latter would be the be-all end-all.

But the kids in Business School would constantly write him and ask him for new ways to rig the game.

Re:Nate Silver confuses cause and effect, ends up defending ... by cube13 on Thursday December 20, 2012 @02:27PM (#4949448)
In order for this to be true, she needed to make the argument that it is. She's not saying anything to that effect at all.
Re:Nate Silver confuses cause and effect, ends up defending ... by sillysaurus on Thursday December 20, 2012 @02:35PM (#4949484)
If her point wasn't "corruption caused the financial meltdown," then why did she write this piece?

The simplest explanation is that she was, in fact, arguing that corruption caused the financial crisis.

Re:Nate Silver confuses cause and effect, ends up defending ... by chc on Thursday December 20, 2012 @02:29PM (#4949455)
You're imposing a cause/effect dichotomy that doesn't actually exist. Most causes are effects of something else. When we talk about mixing up cause and effect, we mean that A is said to have caused B when in actuality A was caused by B. Showing that A was caused by C does not mean that we've mixed up cause and effect, because nobody said A caused C.
Re:Nate Silver confuses cause and effect, ends up defending ... by hsitz on Thursday December 20, 2012 @02:33PM (#4949476)
"The bad models were a consequence of a fraudulent system. So by definition, the models weren't the cause of the financial crisis. Therefore the bad models were an effect, in the same way the financial crisis was an effect."

This is faulty reasoning. A pool ball may go into a pocket because it was hit by a cue ball. In this case the cue ball hitting the other ball is the cause of the other ball falling into the pocket. Yes, you can look back into the chain of causes to find one further back, e.g., the fact that a person used a pool cue to hit the cue ball into the other ball. This doesn't mean that the first cause you found was not a cause, and certainly doesn't mean that "by definition".

If a corrupt and fraudulent system could have brought about the financial crisis by some means other than causing bad models (which I assume is true), then you can say that the bad models were not a necessary part of the causal chain. But you can't say that they weren't part of the causal chain at all. As a matter of fact (at least according to assumptions everyone is making in this topic's thread) they were.

Re:Nate Silver confuses cause and effect, ends up defending ... by tomkarlo on Thursday December 20, 2012 @02:47PM (#4949545)
I'm not sure you can get to the financial crisis without faulty models. Risk models, especially on packaged securities, are crucial to setting ratings as a proxy for risk. Those ratings are key to determining pricing, maximum leverage, and which portfolios can buy them.

If the models had been more accurate - for example, if they had more properly reflected the way that the value of a bundle of mortgages will suddenly lose value as housing prices decline - banks would not have been able to pile up such huge risks and high leverage.

You can only justify things like 30X leverage if you believe the securities in question have essentially no risk - because at that leverage, a 3% loss in value means you're wiped out.

Re:Nate Silver confuses cause and effect, ends up defending ... by pdonis on Thursday December 20, 2012 @03:04PM (#4949645)
I'm not sure you can get to the financial crisis without faulty models.

Sure you can. The root cause of the crisis was people gaming the system. There are many ways to game the system; faulty models are only one of them.

Re:Nate Silver confuses cause and effect, ends up defending ... by tomkarlo on Thursday December 20, 2012 @07:19PM (#4950816)
Okay, but all routes to that gaming - at least at the institutional level - ran through being able to do it without it impacting credit ratings. Credit ratings and security pricing are very dependent on statistical models for risk, in particular correlation and downside outcomes.
Re:Nate Silver confuses cause and effect, ends up defending ... by pdonis on Thursday December 20, 2012 @08:08PM (#4950969)
all routes to that gaming

All routes to that particular method of gaming. There are other methods.