News for hackers. Stuff that matters.
Re:NTSB identifies origin of JAL Boeing 787 battery fire by magic_haze on Thursday February 07, 2013 @02:10PM (#5183929)
Interesting bits:

> the majority of evidence from the flight data recorder and both thermal and mechanical damage pointed to an initiating event in a single cell. That cell showed multiple signs of short circuiting, leading to a thermal runaway condition, which then cascaded to other cells.

> Boeing ... determined that the likelihood of a smoke emission event from a 787 battery would occur less than once in every 10 million flight hours ... there have been two critical battery events on the 787 fleet with fewer than 100,000 flight hours.

Seems like Musk was right in his guess after all (http://www.flightglobal.com/news/articles/elon-musk-boeing-7...), but it is shocking how badly Boeing got its estimates wrong. Does anyone know exactly how they came up with these numbers?

Re:NTSB identifies origin of JAL Boeing 787 battery fire by vermontdevil on Thursday February 07, 2013 @02:38PM (#5184071)
From what I have been reading, it seems non-engineering people have taken over Boeing. I wouldn't be surprised these suits have been pressuring everyone to get the 787 out and the culture goes from there.
Re:NTSB identifies origin of JAL Boeing 787 battery fire by dmethvin on Thursday February 07, 2013 @03:35PM (#5184339)
It really feels a lot like the shuttle disasters, with Boeing playing the part of NASA and delegating work out to contractors who feel they must get something out or risk losing the next big contract. God forbid if this does come down to a disaster it will be even more difficult to unravel, since this time it will cross political and cultural boundaries.
Re:NTSB identifies origin of JAL Boeing 787 battery fire by wpietri on Thursday February 07, 2013 @05:20PM (#5184899)
That reminds me of HP. I grew up using their awesome technical products (RPN represent!) and now I get sad every time I see them in the news.

Have any pointers on the switch from engineering-driven to whatever they are now? I'd love to read more.

Re:NTSB identifies origin of JAL Boeing 787 battery fire by InclinedPlane on Thursday February 07, 2013 @05:24PM (#5184933)
I have an hp48 emulator on my phone, I use it all the time these days.
Re:NTSB identifies origin of JAL Boeing 787 battery fire by InclinedPlane on Thursday February 07, 2013 @04:40PM (#5184671)
I think it's unfair to call Musk's opinion a "guess". It is a sound criticism of the fundamental safety margin of those cells, and it was backed up by other experts.
Re:NTSB identifies origin of JAL Boeing 787 battery fire by zalzane on Thursday February 07, 2013 @04:48PM (#5184722)
I disagree. Any statement about a piece of engineering without having seen the schematics, diagrams, and tests involved is at best, speculation.
Re:NTSB identifies origin of JAL Boeing 787 battery fire by InclinedPlane on Thursday February 07, 2013 @05:22PM (#5184913)
If it's a fundamental design aspect such as the size and spacing of cells in a battery I don't think detailed schematics are necessary. If I saw a sketch of a car design which called for the fuel tank to be an open top 5 gallon plastic bucket sitting in the passenger's seat with a hose going into it I wouldn't need any additional or more finely grained details to be able to definitively say that it's an inherently unsafe system. If I saw a sketch of a bridge with a 50 meter gap in the bridge deck I shouldn't think to myself "oh, maybe it's just for hovercars, or maybe they've invented something revolutionary" I should think "that's a fundamentally broken bridge design". Sometimes the finer details of a design matter, and sometimes there's no possible way for them to correct for a fundamental design error.

Unless Boeing's subcontractors have made ground breaking advances in the design of lithium-ion cells then these criticisms are enormously well founded. And as we've seen those subcontractors have not, in fact, found a magical escape from the fundamental problems of thermal runaway and chain-reaction in lithium-ion cells.

Re:NTSB identifies origin of JAL Boeing 787 battery fire by fleitz on Thursday February 07, 2013 @05:44PM (#5185017)
Yup, or as we call it in our industry: code smell.

A good engineer doesn't need to see detailed diagrams, etc, pop open a couple files and you've got a pretty good idea of whether a project is good, or is fucked.

Re:NTSB identifies origin of JAL Boeing 787 battery fire by Eliezer on Thursday February 07, 2013 @05:17PM (#5184885)
He was right on this occasion. I always wait to criticize other people's methods until an occasion when they're actually wrong.
Re:NTSB identifies origin of JAL Boeing 787 battery fire by fnordfnordfnord on Thursday February 07, 2013 @04:58PM (#5184788)
I might call it an informed opinion.
Re:NTSB identifies origin of JAL Boeing 787 battery fire by fusiongyro on Thursday February 07, 2013 @02:42PM (#5184091)
I thought this sentence was particularly revealing: "In tests to validate these assessments, Boeing found no evidence of cell-to-cell propagation or fire, both of which occurred in the JAL event."
Re:NTSB identifies origin of JAL Boeing 787 battery fire by magic_haze on Thursday February 07, 2013 @02:48PM (#5184118)
yeah, that was the part that had me confused... how does that square with the 10-million-hour figure? Or is a fire not considered a "smoke emission event"?
Re:NTSB identifies origin of JAL Boeing 787 battery fire by KMag on Thursday February 07, 2013 @03:25PM (#5184298)
You appear to be mis-parsing "In tests to validate these assessments". "These assessments" refers to Boeing's certification assessments, not the NTSB's incident assessment.

Long before any incidents, Boeing estimated a smoke event as once in 10 million hours. The measured rate of fire events is much higher than Boeing's pre-certification estimate of the rate of smoke events. There is absolutely no implication that Boeing's definition of smoke event doesn't include fires.

Edit: as mentioned below, the real problem seems to be that you're assuming smoke implies fire, when smoke merely suggests fire.

Re:NTSB identifies origin of JAL Boeing 787 battery fire by magic_haze on Thursday February 07, 2013 @04:05PM (#5184502)
No, I understand that. Here's the full context of the two sentences:

> During the 787 certification process, Boeing studied possible failures that could occur within the battery. Those assessments included the likelihood of particular types of failures occurring, as well as the effects they could have on the battery. In tests to validate these assessments, Boeing found no evidence of cell-to-cell propagation or fire, both of which occurred in the JAL event. The NTSB learned that as part of the risk assessment Boeing conducted during the certification process, it determined that the likelihood of a smoke emission event from a 787 battery would occur less than once in every 10 million flight hours.

So, to summarize, in the certification process, Boeing claimed:

a: no evidence of a fire.

b: a 10-million-hour estimate for a "smoke event".

My original question was merely from a statistical/technical perspective: how is this figure calculated if they have no evidence of the event they are supposed to measure? From my understanding, automobiles undergoing similar certification are tested under abnormally rigorous conditions, and the chances of those conditions happening are taken into account when calculating failure rates. But if Boeing claims it had no evidence of a fire happening at all, what is the reasoning behind the number? Is it just a convenient way to say probability=0?

Re:NTSB identifies origin of JAL Boeing 787 battery fire by Dove on Thursday February 07, 2013 @04:32PM (#5184627)
I would imagine some sort of fault tree analysis. Safety engineering in complex systems does that a lot: you start with an event you don't want to happen, imagine all the ways it could happen, estimate the probabilities of each contributing factor, and do the math.

http://en.wikipedia.org/wiki/Fault_tree_analysis

It sounds like one of their incoming assumptions--a probability, a manufacturing spec, something like that--didn't match up with reality. That happens. They're probably going over the fault tree, madly trying to figure out which one and by how much.

Re:NTSB identifies origin of JAL Boeing 787 battery fire by cpleppert on Thursday February 07, 2013 @04:46PM (#5184709)
>>So, to summarize, in the certification process, Boeing claimed: a: no evidence of a fire. b: a 10-million-hour estimate for a "smoke event".

Boeing counted a malfunction as a "smoke event" which is a release of emissions from a battery overheating, not necessarily a fire. The no evidence of a fire is a claim that regardless of a battery failure, there is no plausible failure chain that leads to a fire beginning in the battery.

>>But if Boeing claims it had no evidence of a fire happening at all, what is the reasoning behind the number? Is it just a convenient way to say probability=0?

In the case of a fire, yes. But this just means that the battery fault alone won't cause a fire. If other systems fail all bets are off. I suspect you are conflating smoke event with a fire.

>>My original question was merely from a statistical/technical perspective: how is this figure calculated if they have no evidence of the event they are supposed to measure? From my understanding, automobiles undergoing similar certification are tested under abnormally rigorous conditions, and the chances of those conditions happening are taken into account when calculating failure rates.

As I explained above, Boeing claimed that it was possible that a battery could malfunction(one in ten million hour), but they had no plausible scenario that could lead to a fire. In this case, battery malfunctioning does not necessarily equal a fire. The smoke event is calculated from a number of probabilistic factors such as the confluence of the possibility of electrical overcharging and arcing and simple faults with the battery. It is a made up number that doesn't take into account that this is a new design that introduces other possibilities of failure.

Re:NTSB identifies origin of JAL Boeing 787 battery fire by KMag on Thursday February 07, 2013 @04:47PM (#5184713)
Ahh... you're assuming that "where there's smoke, there's fire". You apparently haven't done much cooking. Smoke may suggest fire, but it doesn't imply fire.

If smoke doesn't imply fire then P(smoke) > 0 doesn't imply P(fire) > 0.

Re:NTSB identifies origin of JAL Boeing 787 battery fire by fusiongyro on Thursday February 07, 2013 @05:35PM (#5184976)
Fire, on the other hand, should imply smoke. So they estimated P(smoke) as being 1:10M hours, but we got fire with 2:10K, which suggests that P(smoke) is at least 1:5K or more often.
Re:NTSB identifies origin of JAL Boeing 787 battery fire by fleitz on Thursday February 07, 2013 @05:46PM (#5185026)
To be fair, Boeing could have just gotten incredibly unlucky. I kind of doubt it given assessments of the situation, but it's within the realm of possibility.
Re:NTSB identifies origin of JAL Boeing 787 battery fire by smackfu on Thursday February 07, 2013 @04:37PM (#5184650)
> it is shocking how badly Boeing got its estimates wrong. Does anyone know exactly how they came up with these numbers?

Eh, I don't think that means much. You can't put odds on an unknown failure mode.

Re:NTSB identifies origin of JAL Boeing 787 battery fire by InclinedPlane on Thursday February 07, 2013 @04:42PM (#5184677)
Thermal runaway in Lithium-ion and Lithium-polymer batteries is not an "unknown failure mode", it should be constantly in the front of mind every day for everyone working on such cells.
Re:NTSB identifies origin of JAL Boeing 787 battery fire by fnordfnordfnord on Thursday February 07, 2013 @04:55PM (#5184773)
>Seems like Musk was right in his guess after all.

Yeah, some luck that guy has...

Re:NTSB identifies origin of JAL Boeing 787 battery fire by maaku on Thursday February 07, 2013 @05:21PM (#5184910)
Either that, or he runs the only other engineering company of similar scale using similar batteries under similar conditions.