News for hackers. Stuff that matters.
Re:NASA advisers say SpaceX rocket technology could put live... by citilife on Sunday May 06, 2018 @01:44PM (#17007341)
I think the last paragraph really says it all:

> Before the very first shuttle flight, NASA estimated that the chance of death was between 1 in 500 and 1 in 5,000. Later, after the agency had compiled data from shuttle flights, it went back and came up with a very different number. The chance of death was actually 1 in 12.

The fact is, these numbers are made up because the systems are too complicated to calculate based on individual components. Until they have something like 50+ launches (after the kinks are worked out), we wont really know the actual chances of blowing up a rocket are. Further, how well do the escape capsule(s) work? If they work the majority of the time (saving astronauts from he explosion), that'd also dramatically drive down the risk.

If say, there was a 1 in 30 chance of a rocket exploding using the method described, but the escape capsule failed to save the astronauts 1 out of 10 times. Then the real risk of killing the astronauts is 1 in 300. Unfortunately, we simply don't have either of those numbers, so the actual "risk" level is essentially made up.

Re:NASA advisers say SpaceX rocket technology could put live... by Balgair on Sunday May 06, 2018 @09:29PM (#17009767)
I used to do reliability analyses for a large aerospace contractor, I may have some insights. The stuff I worked on was not HSF (Human Space Flight) just automated sats and the like. Each and every single part is spoken for and tallied. Each resistor on a PCB, each explosive bolt, each screw and panel. All of it has a lifetime curve, typically a Bathtub plot, to an extreme degree. Resistors were tested in vast batches, over vast I-V ranges, in hard radiation and vacuum, in vibe, for long periods. You calculate it all out. Something approaching the far upper reaches of the expected 'black swans' is tested and the part is proofed against it. Our stuff was just comms and the like, granted, but even then, the expected lifetime of each satellite was fairly well known out to about 20 years in orbit. A typical figure for a 15 year mission was a 75% chance of it making it the whole way, including launch. It's checked to an extreme degree. I've had people come back and correct an un-dotted 'i' symbol in a handwritten notebook. Really.

HSF is easily 100x higher tolerances.

Some stuff, you have to live with, some stuff (like the panels and the o-rings) is too far fetched for even NASA to think up beforehand. And if you've ever been to The Cape, you know they will never forgive themselves. They try their very best to think it all up. They really really do. NASA may be full of brains, but damned if they aren't all real heroes there on the ground. Those folk have heart more than anything else.

Per Aspera Ad Astra does not fucking cut it.

Re:NASA advisers say SpaceX rocket technology could put live... by sitkack on Sunday May 06, 2018 @10:23PM (#17009967)
> o-rings

Were a known weakness.

Re:NASA advisers say SpaceX rocket technology could put live... by Balgair on Monday May 07, 2018 @08:08PM (#17017609)
My mistake! Thanks for the correction!
Re:NASA advisers say SpaceX rocket technology could put live... by CamperBob2 on Sunday May 06, 2018 @11:29PM (#17010215)
Exactly. That's the last example anyone should cite when arguing that the process has the interests of safe human spaceflight in mind.
Re:NASA advisers say SpaceX rocket technology could put live... by imjustsaying on Sunday May 06, 2018 @11:13PM (#17010158)
> A typical figure for a 15 year mission was a 75% chance of it making it the whole way, including launch. It's checked to an extreme degree. I've had people come back and correct an un-dotted 'i' symbol in a handwritten notebook. Really.

Can you break down this calculation? Where did 75% come from? I think your parent poster's point is this: no one really knows where these numbers are coming from.

Re:NASA advisers say SpaceX rocket technology could put live... by simonh on Sunday May 06, 2018 @11:31PM (#17010222)
>...no one really knows where these numbers are coming from.

That was actually explained in the (excellent) comment. Snippet below, but please re read the comment or example how resistors are actually tested in batches to give real failure rates.

>Each resistor on a PCB, each explosive bolt, each screw and panel. All of it has a lifetime curve, typically a Bathtub plot, to an extreme degree

Re:NASA advisers say SpaceX rocket technology could put live... by Balgair on Tuesday May 08, 2018 @05:12PM (#17025160)
I'll admit, a lot of the time, you just can't get good enough vacuum on Earth. The best we could do was the nano-torr range, but space is much better. This does effect testing somewhat. Also, a lot of the time, it's the 'black swans' that really matter. Fun fact: the Hubble flies butt first, as they experimentally discovered that meteorites will affect the telescope less than flying it lenses first. I can't find the pic right now, but there is a softball sized hole in the computer (butt) section.
Re:NASA advisers say SpaceX rocket technology could put live... by afterburner on Sunday May 06, 2018 @02:46PM (#17007687)
> If say, there was a 1 in 30 chance of a rocket exploding using the method described, but the escape capsule failed to save the astronauts 1 out of 10 times. Then the real risk of killing the astronauts is 1 in 300.

That's the same kind of mistake NASA made, just multiplying stuff like it was a high school textbook question.

What if the very things that make a rocket explode also make the escape capsule fail?

Re:NASA advisers say SpaceX rocket technology could put live... by Retric on Sunday May 06, 2018 @04:10PM (#17008235)
Escape capsules are not used when the rocket is ok. So, 1 in 10 chance of failure would likely include dammage from an exploding rocket.

NASA's problem was their two failures did not result from any one component of the original design failing. One was used out of spec and the foam had been changed from the initial design.

Re:NASA advisers say SpaceX rocket technology could put live... by EthanHeilman on Sunday May 06, 2018 @06:43PM (#17009049)
>Escape capsules are not used when the rocket is ok. So, 1 in 10 chance of failure would likely include dammage from an exploding rocket.

I agree that a very effective escape system, as it appears the f9 has, makes the rocket far safer. However understanding failure probabilities is much complex than this thread is making it sound. For instance you could have a escape system failure that triggers the exploding rocket or a software system failure which causes both the rocket to explode and the escape system to fail. Take a look at 'Engineering a safer world' for an idea of how NASA and other parties actually calculate these probabilities: https://mitpress.mit.edu/books/engineering-safer-world

Re:NASA advisers say SpaceX rocket technology could put live... by Retric on Sunday May 06, 2018 @07:14PM (#17009190)
I think you missed my point.

If you have the actual probabilities, which include cascade failures and one of the systems is a safety backup system not in normal use then multiplication is reasonably though not completely accurate. Though, you do need to consider the failure of the safety system when the normal system is operating correctly, but that's also much easier to avoid so likely very very low.

Cascade failures are a far more complex situation and thus harder to predict. So again, it depends on what the failure rate is describing not just what the number is.

Re:NASA advisers say SpaceX rocket technology could put live... by garmaine on Sunday May 06, 2018 @04:05PM (#17008218)
> The fact is, these numbers are made up because the systems are too complicated to calculate based on individual components

No, you can perfectly well calculate component-by-component and come up with the 1 in 500 number. That's what NASA did (at great expense). What they failed to realize was this was only considering known-unknowns, and actual experience using the stack is required to learn about the unknown-unknowns which dominated the analysis.

Re:NASA advisers say SpaceX rocket technology could put live... by cjslep on Sunday May 06, 2018 @06:31PM (#17009003)
This response deserves to be listed higher. I participated in risk assessment analyses, specifically for nuclear powerplants, specifically for extremely rare wind events. The nuclear industry is like the space one and has had to learn about unknown unknowns the hard way.
Re:NASA advisers say SpaceX rocket technology could put live... by garmaine on Sunday May 06, 2018 @07:07PM (#17009164)
Yup. It comes up in other contexts too. In project risk assessment (“will we deliver on time?”) it is known as the inside view vs the outside view. The inside view is: here are all the parts we need to make, and how long each creation and integration step by itself should take, with known risks factored in. The outside view is: ok but the last 3 times we did something on this scale it took 2+ years when we thought it would take just 6 months.

You can use an inside-view analysis to get a minimum risk assessment. Something would have been very wrong in the analysis if we didn’t lose 1 in 500, since that’s the risk we expected from known factors.

And the outside view can give you a reasonable handle on maximums: objectively the risk of shuttle loss was about 1:75 or so, because that is what actually happened. If we were to have continued the shuttle program instead of cannibalizing it for the now defunct Constellation, we could have confidence that failures going forward would be at least 1:75 or better as we fix things, assuming regressions are rare.

The failure by NASA was in treating the inside view known-unknowns risk assessment as a maximum (“risk of loss is NO MORE THAN...”) when it was really a minimum (“risk of loss is AT LEAST...”).

Re:NASA advisers say SpaceX rocket technology could put live... by jessaustin on Sunday May 06, 2018 @01:58PM (#17007421)
Since the actual disaster record for the shuttle was 2/135, they must have done some other adjustments to come up with 1/12. Still, at this point it seems very likely that SpaceX will be safer than the shuttle.
Re:NASA advisers say SpaceX rocket technology could put live... by Robotbeat on Sunday May 06, 2018 @03:55PM (#17008144)
The first flights were more risky than later ones. They made improvements. But there were many close calls (including main engine failure).

But SpaceX necessarily WILL be safer because they're using a proven vehicle and a more robust capsule. Plus a launch abort system. Shuttle flew crewed on the very first launch.

Re:NASA advisers say SpaceX rocket technology could put live... by MPSimmons on Sunday May 06, 2018 @06:19PM (#17008934)
There's also the concept of the "Drift into Failure", which I believe was coined by Sydney Dekker (https://www.amazon.com/Drift-into-Failure-Components-Underst...), where small compromises in operations eventually cause very important security and reliability protections to be eroded away.
Re:NASA advisers say SpaceX rocket technology could put live... by Robotbeat on Sunday May 06, 2018 @07:40PM (#17009305)
i tend to think this is a strength of the Russian R7/Soyuz: the vast majority of the R7 launch family launches are uncrewed (and with a lower level of "mission assurance," i.e. less double-checking), therefore any systemic problems (i.e. due to "drift into failure," etc) are almost certainly going to be caught in an uncrewed launch first. Likewise, uncrewed Progress cargo spacecraft missions use a very similar platform as the Soyuz spacecraft, I think on the same line, so problems with the spacecraft can also be found on uncrewed missions.

Falcon 9 is planned to launch maybe twice a year crewed, compared to 20 or 30 uncrewed launches (including like 2 or 3 uncrewed Dragon launches), meaning any new systemic problems with the launch vehicle will almost certainly pop up in an uncrewed launch before they result in loss of crew. Shuttle ONLY launched uncrewed, therefore any systemic problem which resulted in a loss of vehicle necessarily resulted in loss-of-crew.

Re:NASA advisers say SpaceX rocket technology could put live... by greglindahl on Sunday May 06, 2018 @11:27PM (#17010205)
Yes, so in the F9 case, that only works well if NASA doesn't insist that the one crew launch per year doesn't use a super-unique rocket. Which appears to be something that the safety committee appreciates, but maybe not far enough.
Re:NASA advisers say SpaceX rocket technology could put live... by fao_ on Sunday May 06, 2018 @10:14PM (#17009931)
> Shuttle ONLY launched uncrewed, therefore any systemic problem which resulted in a loss of vehicle necessarily resulted in loss-of-crew.

Don't you mean that shuttle only launched crewed? Either that or I think I do not have the same definition as you do for "uncrewed" -- I take it to mean that there is no crew on board?

Re:NASA advisers say SpaceX rocket technology could put live... by simonh on Sunday May 06, 2018 @11:35PM (#17010238)
It just looks like a typo.
Re:NASA advisers say SpaceX rocket technology could put live... by Robotbeat on Monday May 07, 2018 @12:25AM (#17010387)
Yes. And I'm out of the edit window.
Re:NASA advisers say SpaceX rocket technology could put live... by justin66 on Sunday May 06, 2018 @07:21PM (#17009217)
> But there were many close calls (including main engine failure).

When did the shuttle main engine fail?

Re:NASA advisers say SpaceX rocket technology could put live... by Robotbeat on Sunday May 06, 2018 @07:30PM (#17009256)
One of the three SSMEs failed on STS-51F https://en.wikipedia.org/wiki/STS-51-F due to sensor malfunction. Another engine nearly failed for the same reason, but quick action from the crew prevented shutdown. The Shuttle performed an Abort-to-orbit, meaning it continued to a lower contingency orbit.

And STS-93 had a pretty bad close call, too, with some of the engine coolant lines rupturing in-flight (leading to early shutdown) due to a oxidizer post plug coming undone as well as an electrical short taking down some of the engine controllers. That was pretty early in flight, so would've been incredibly risky in the case of an abort. https://en.wikipedia.org/wiki/STS-93

Falcon 9 has higher levels of first stage redundancy than Shuttle (can lose a first stage engine immediately at lift-off and reach orbit just fine, and lose multiple engines later in flight), and uses just a single upper stage engine, reducing probability of failure.

Re:NASA advisers say SpaceX rocket technology could put live... by craftyguy on Sunday May 06, 2018 @02:09PM (#17007484)
2/135 is failed flights/total flights.

Over the life of the shuttle[0], there were 355 astronauts who flew, 14 died. So for every ~25 astronauts who flew on the shuttle, 1 died..

0) https://www.space.com/12376-nasa-space-shuttle-program-facts...

Re:NASA advisers say SpaceX rocket technology could put live... by TangoTrotFox on Sunday May 06, 2018 @03:33PM (#17007999)
Take an example of why this number is probably not as meaningful as you might think. We have only one astronaut. And this astronaut flies on a ship 1000 times. And then on the 1000th time it blows up. Well we had 1 astronaut that flew and he died. So it would be fair to say that 100% of astronauts that flew on our imaginary ship died on it, but it would lack much of any meaning.

Accounting for repeats, there were 833 individuals that flew on the shuttle and 14 died. The ratio there is about 60:1 which is predictably comparable to the ratio of successful:failed flights.

Re:NASA advisers say SpaceX rocket technology could put live... by ebbv on Sunday May 06, 2018 @02:15PM (#17007516)
Oh my lord you guys that is not how probabilities work. You can’t look at what actually happened and then say “Well that was the chance.” If I flip a coin 20 times and happen to end up with a 15:5 split that doesn’t mean the chance of heads is 3:1.

Also the context of that 1 in 12 in the quote is important. They’re saying that was the chance on the first flight in retrospect. The shuttle and it’s supporting facilities and processes didn’t stay static, they improved over time.

Re:NASA advisers say SpaceX rocket technology could put live... by joshuamorton on Sunday May 06, 2018 @02:33PM (#17007616)
>Oh my lord you guys that is not how probabilities work. You can’t look at what actually happened and then say “Well that was the chance.” If I flip a coin 20 times and happen to end up with a 15:5 split that doesn’t mean the chance of heads is 3:1.

Erm, over a large sample size, yes this is exactly how things work. Sure 15/5 may be too small, but 150/50 isn't. That's well after the point where its reasonable to believe that your coin is rigged.

As the other user mentioned, if you don't have the prior that the coin is fair, a 15/5 outcome may (and does) indeed imply that heads are more likely than tails. In fact, 15/5 would imply a less than 1% chance of a fair coin, given uniform priors. (Beta[15, 5] -> 1st percentile is 50.175)

Re:NASA advisers say SpaceX rocket technology could put live... by pps43 on Sunday May 06, 2018 @02:43PM (#17007667)
But in this case the samples are small. If you flip a coin once and got tails, what is the probability of heads?
Re:NASA advisers say SpaceX rocket technology could put live... by joshuamorton on Sunday May 06, 2018 @02:58PM (#17007769)
That's not quite the same question as what I'm answering. I'm saying "given you flip a coin once and it comes up heads, what is the probability that its a fair coin" (or previously, given you flipped a coin 20 times, and it came up 15/5, what is the likelyhood it is a fair coin). And with a single flip, you can't actually answer that question (BetaDist[1, 0] is undefined).

Now, once you've answered that question, you can integrate to get a probability that the next coin is heads, but with a single flip you can't even answer the first question. You need to have gotten heads and tails each at least once.

Re:NASA advisers say SpaceX rocket technology could put live... by isostatic on Sunday May 06, 2018 @04:19PM (#17008277)
Flip a coin 50 times and get 50 heads, it's almost impossible it's a fair coin. Does your BetaDist function work in that case?
Re:NASA advisers say SpaceX rocket technology could put live... by joshuamorton on Sunday May 06, 2018 @04:35PM (#17008366)
No, the beta distribution BetaDist[a, b] is only defined for a, b strictly > 0.

When a or b is very large and the other is zero, you can treat it as 1 and get a decent approximation, but it'll be a an estimate that biases towards the center.

Re:NASA advisers say SpaceX rocket technology could put live... by joshuamorton on Monday May 07, 2018 @03:34PM (#17015751)
I should also mention that if you're willing to make assumptions like a uniform prior, this totally works, but it can lead to some surprising results for small a, b. Notably a uniform prior is Beta[1, 1]. Beta[2,1] implies something like a 75% chance of the true mean being above .5, which seems a tad overzealous.
Re:NASA advisers say SpaceX rocket technology could put live... by pps43 on Sunday May 06, 2018 @04:40PM (#17008395)
Exactly, that's not the question you're answering, but it is the question that is being asked in this context: what is the probability of rapid unplanned disassembly of SpaceX rockets.
Re:NASA advisers say SpaceX rocket technology could put live... by joshuamorton on Monday May 07, 2018 @12:04AM (#17010322)
Hence the "but you can integrate to answer that".

If your rocket has a 50% chance of being explosion proof and a 50% chance of blowing up half the time (you could imagine this as any number of situations, like two otherwise identical rockets which you use), any given launch has a 25% chance of rapid unplanned disassembly.

You can do the same thing over a continuous random variable.

Re:NASA advisers say SpaceX rocket technology could put live... by pps43 on Monday May 07, 2018 @04:31PM (#17016241)
But you know neither the chance of the new rocket being explosion proof, nor the chance of the rocket blowing up half the time.

You built the rocket, launched it once, and it did not blow up. What should be integrated to get the probability of rapid unplanned disassembly?

Re:NASA advisers say SpaceX rocket technology could put live... by joshuamorton on Monday May 07, 2018 @05:15PM (#17016548)
Enter the Beta(variate) distribution.

The beta distribution[1] is a cool statistical distribution defined by BetaDist{a,b} (or alpha, beta, but that's too much work), where a is the number of successes and b is the number of failures you've sampled.

It has a number of cool properties, chief among them that given X = BetaDist{a,b}, then cdf(X, x) = the probability that the mean of the distribution you are approximating is less than x. It has a bunch of other nice properties too (like E[X] = a / (a + b), which should be obvious), but those aren't as relevant here.

So let's say that you assume a uniform prior. This is defined as BetaDist{1,1} [2]. this is probably the wrong prior. So you might have a better idea. If, for example, you believe there is a 10% chance of your rocket exploding based on some calculations you've done, you might use a differently tuned beta distribution, like BetaDist{9,1} or BetaDist{4.5,.5} if you were feeling uncertain (but in general it would likely be better to use {8,2} in that situation iirc). But let's assume {1,1} for now.

So you launch your rocket. Everything goes great. You update your distribution. Its a success. So you get BetaDist{2,1} [3]. So what is the chance your rocket explodes? Well the cdf of your beta distribution is the probability that the mean is less than x. So the pdf of the beta distribution is the probability that the mean is exactly x. So then

The integral from 0 -> 1 of `(1 - x) * pdf(X, x) dx` is the estimated probability that your rocket explodes on its next launch, since that's "for every value x, the likelyhood of the distribution being that one multiplied by the chance your rocket explodes given that distribution". For the one rocket case, this happens to be equal to E[X] = a / (a + b), so it's 1/3.

For the two rocket case, you apply reinforcement learning/k-armed bandit strategies like UBC1[4] or Thompson Sampling[5]. These are algorithms that will result in you picking the best rocket with as few unnecessary explosions as possible, provably.

You can see some related discussion I've had on HN about these algorithms [6].

[1]: https://en.wikipedia.org/wiki/Beta_distribution

[2]: http://www.wolframalpha.com/input/?i=beta+distribution+(1,1)

[3]: http://www.wolframalpha.com/input/?i=beta+distribution+(2,+1...

[4]: http://banditalgs.com/2016/09/18/the-upper-confidence-bound-...

[5]: https://en.wikipedia.org/wiki/Thompson_sampling

[6]: https://news.ycombinator.com/item?id=17014232

Re:NASA advisers say SpaceX rocket technology could put live... by pps43 on Monday May 07, 2018 @07:50PM (#17017488)
Wouldn't it be easier to just add one success and one failure and calculate (events+1)/(trials+2) instead of events/trials?
Re:NASA advisers say SpaceX rocket technology could put live... by joshuamorton on Tuesday May 08, 2018 @12:16PM (#17022064)
I'm not sure what you mean.
Re:NASA advisers say SpaceX rocket technology could put live... by pps43 on Tuesday May 08, 2018 @01:13PM (#17022614)
I'm talking about pseudocounts (add one success and one failure) [1] or maybe Agresti-Coull estimator (add two successes and two failures) [2].

[1] https://en.wikipedia.org/wiki/Rule_of_succession

[2] http://users.stat.ufl.edu/~aa/articles/agresti_coull_1998.pd...

Re:NASA advisers say SpaceX rocket technology could put live... by ebbv on Sunday May 06, 2018 @03:15PM (#17007876)
Yes if you actually run an experiment with real sample sizes you can begin to form hypothesis around and unknown probability.

But my point was you cannot look at a historical event and say "Well this happened, so that was the chance." That's the basis for the silly internet joke "The chance is 50/50, either it happens or it doesn't."

Which is what the people I replied to were doing.

Re:NASA advisers say SpaceX rocket technology could put live... by joshuamorton on Sunday May 06, 2018 @03:38PM (#17008022)
>But my point was you cannot look at a historical event and say "Well this happened, so that was the chance."

If the event happens repeatedly, you absolutely can! If someone attempts something 20 times, and it works 10 of them, you can conclude that there's an approximately 50% chance of success. You have a sample size! The exact same thing is true for a statement like "the chance of an astronaut dying is approximately 1 in 25". We have the sample size to show that.

>That's the basis for the silly internet joke "The chance is 50/50, either it happens or it doesn't."

No, that's totally different. That's a misunderstanding of priors. What you're doing is more like forgetting that the law of large numbers is a thing.

Re:NASA advisers say SpaceX rocket technology could put live... by ebbv on Sunday May 06, 2018 @03:44PM (#17008066)
I’m not forgetting anything. The actual shuttle missions were not a statistical experiment or a consistent action where you can say “well this is what happened so that was the chance of death on an individual shuttle flight.”

It only means that’s your chance if you have the technology from quantum leap (the tv show) and you randomly land in the body of one of the participants.

as I said already the shuttle and everything around it evolved. The crews changed. Trying to say “the actual chance of death was this based on how many people died.” is silly.

Re:NASA advisers say SpaceX rocket technology could put live... by joshuamorton on Sunday May 06, 2018 @03:53PM (#17008134)
>It only means that’s your chance if you have the technology from quantum leap (the tv show) and you randomly land in the body of one of the participants

No, then the event already happened, so you know the outcome with certainty.

> The actual shuttle missions were not a statistical experiment or a consistent action where you can say “well this is what happened so that was the chance of death on an individual shuttle flight.”

Indeed there are confounding factors that make the error nontrivial. This doesn't invalidate the entire experiment.

>Trying to say “the actual chance of death was this based on how many people died.” is silly.

Its exactly as silly as saying "the actual chance of getting heads is based on how many heads you get". The problem with your argument is that that isn't silly. To calculate how likely getting heads is, you flip the coin a bunch of times, see how many heads you get, and then you have your answer (and a confidence level). Its the opposite of silly.

In other words, there's no big difference between "We'll flip a bunch of coins to see how likely we are to pull heads" and "we'll launch a bunch of people into space to see how likely they are to end up dead". The second isn't as rigorously controlled as the first, but that's fine as long as you account for it.

Re:NASA advisers say SpaceX rocket technology could put live... by Spooky23 on Sunday May 06, 2018 @08:21PM (#17009511)
I think the difference is the scope of the problem. A coin flip is a deterministic, known event with two possible answers in most situations.

A rocket or space shuttle launch is like a thousand coin flips, where any one result, sequence of results or other combination of events results in death. As an added bonus, any number of unknown external events, from Ambient temperature, to bird strike, to sabotage can render the model useless and kill you in some unforeseen way.

Re:NASA advisers say SpaceX rocket technology could put live... by TeMPOraL on Monday May 07, 2018 @06:08AM (#17011549)
The scope is different, but the principle is the same.

Say you launch your rocket 50 times, out of which 3 times it explodes - first time because of a bird, second time because of the legendary ULA Sniper, third time because of internal problems. That 3/50 is still closer to the truth than just assuming "I really don't know" (1/2) or refusing to answer the question - it has huge error bars, but implicitly captures some of the phenomena that make launches go wrong.

Re:NASA advisers say SpaceX rocket technology could put live... by Spooky23 on Monday May 07, 2018 @02:26PM (#17015108)
That's a great point.

My perspective was probably a little impacted from spending the first truly beautiful day of the summer dealing with a failed "high availability" system. :)

Re:NASA advisers say SpaceX rocket technology could put live... by whatshisface on Sunday May 06, 2018 @02:30PM (#17007606)
If statistics didn't converge to probabilities in the high-n limit then science would be impossible. In the 15:5 coin example, the conclusion is skewed by a massive prior that coins are fair. When we're talking about things like space shuttle launches, it's not reasonable to expect our understanding of the system to be so good that we can boldly forge through with estimates that disagree with results.
Re:NASA advisers say SpaceX rocket technology could put live... by grondilu on Sunday May 06, 2018 @02:35PM (#17007625)
> If I flip a coin 20 times and happen to end up with a 15:5 split that doesn’t mean the chance of heads is 3:1.

Isn't it the best you can say, though? 20 is a small number but when it's all you have, there's nothing you can do about it. Of course we know the "real" probability is a 1/2 because we know how coin tosses work, but if we didn't know it and coin tosses were black boxes, we'd have to go with this 3:1 chance.

Re:NASA advisers say SpaceX rocket technology could put live... by hikarudo on Sunday May 06, 2018 @07:48PM (#17009339)
The chance of heads being 3:1 is the maximum likelihood estimate, which indeed is the best we can do if we don't know anything else. But usually we do have an idea of reasonable values.
Re:NASA advisers say SpaceX rocket technology could put live... by craftyguy on Sunday May 06, 2018 @02:27PM (#17007585)
I didn't say it was a probability. Quite literally, if you look at how many people flew and how many of those died, 1 in 25 died. There was a 100% 'chance' of 1 in 25 dying on the shuttle because that's what actually happened. There's no probability there.
Re:NASA advisers say SpaceX rocket technology could put live... by quickben on Sunday May 06, 2018 @02:43PM (#17007674)
I believe he is right though. You are considering future probability chance, and are right, but he is considering past average. In this case his factual outcome trumps your potential forecast.
Re:NASA advisers say SpaceX rocket technology could put live... by drb91 on Sunday May 06, 2018 @02:30PM (#17007599)
Wait, so a ratio by itself is meaningless without showing how the ratio was derived? If only we could verify the 1/12!
Re:NASA advisers say SpaceX rocket technology could put live... by jacquesm on Monday May 07, 2018 @05:24AM (#17011354)
That's one very twisted way of computing the chance of dying on the shuttle. If you launched the same crew over and over again they would all have died. If you used 'fresh' people for every launch then the chance according to your computation would have been lower.

And yet, through all of that the underlying machinery would be identical and that is the thing we're trying to evaluate here.

So even though you can compute that particular number it is not a very useful number to calculate.

A better way would be to look at the 2/135 number to determine vehicle safety and to use the number of astronauts on board to get to a generic figure and for each individual astronaut to use the 2/135 multiplied by the number of flights they took to figure out their chances.

Of course these are still very low numbers and the error bars will therefore be large.

Re:NASA advisers say SpaceX rocket technology could put live... by jimrandomh on Sunday May 06, 2018 @03:02PM (#17007800)
The 1/12 failure chance was for the first flight, which is inherently riskier than subsequent flights.
Re:NASA advisers say SpaceX rocket technology could put live... by tim333 on Monday May 07, 2018 @05:08AM (#17011313)
It reminds me a bit of Feynman investigating the Challenger disaster:

>Engineers at marshal estimate it as 1/300, while NASA management, to whom these engineers report, claims it is 1/100,000. An independent engineer consulting for NASA thought 1 or 2 per 100 a reasonable estimate

The estimates seem to depend on who is estimating https://science.ksc.nasa.gov/shuttle/missions/51-l/docs/roge...

He had to fight publish that:

>Feynman was so critical of flaws in NASA's "safety culture" that he threatened to remove his name from the report unless it included his personal observations on the reliability of the shuttle, which appeared as Appendix F.

Re:NASA advisers say SpaceX rocket technology could put live... by pizza on Sunday May 06, 2018 @02:31PM (#17007607)
Waiting for an accident to occur before determining that the modifications that allowed it to happen were unsafe -- because the estimates are "essentially made up" -- is just naive.
Re:NASA advisers say SpaceX rocket technology could put live... by marcosdumay on Sunday May 06, 2018 @05:49PM (#17008781)
On practice you will want some independent protection systems, and fix problems as they appear on each of those. On the real world, what is naive is expecting you did in fact know all the failure modes beforehand.

The entire problem with rockets is that you can't fit many such systems into them. So the accidents happen.

Re:NASA advisers say SpaceX rocket technology could put live... by Karishma1234 on Sunday May 06, 2018 @05:45PM (#17008756)
Yes. This is a great reply.

I believe in such super complicated systems there will be a long list of tail risks, probably too hard to compute.

Also at this stage of space exploration we should be focusing on rapid development of technology while keeping humans safe but not putting too much emphasis on safety that we might want to see in our cars.

Re:NASA advisers say SpaceX rocket technology could put live... by TrainedMonkey on Sunday May 06, 2018 @06:07PM (#17008870)
Agree with point on rapid development. Engineering is an iterative process, trying to come up with a perfect system is an anti-pattern. Make something that works and then never stop improving it. Russian Soyuz, SpaceX Merlin, iPhone, ICE, and microprocessors are all examples of where you can get with iterative approach.
Re:NASA advisers say SpaceX rocket technology could put live... by cagenut on Sunday May 06, 2018 @06:44PM (#17009054)
easy for you (or I) to say
Re:NASA advisers say SpaceX rocket technology could put live... by phkahler on Sunday May 06, 2018 @06:42PM (#17009037)
On a related note, I don't see how BFS atop BFR would have that escape capability. OTOH they seem to be aiming for reliability rather than figuring out how to fail safely.
Re:NASA advisers say SpaceX rocket technology could put live... by dvdkhlng on Monday May 07, 2018 @02:27AM (#17010745)
Related video: Video of Soyuz launch escape system used in a real emergency:

https://www.youtube.com/watch?v=UyFF4cpMVag

This is probably how SpaceX imagines astronauts would be saved in case of a fueling problem.