News for hackers. Stuff that matters.
Re:Boeing Withheld Information on 737 Model, According to Sa... by iliketosleep on Tuesday November 13, 2018 @12:43AM (#18438895)
This is part of an unsettling trend where companies prefer to keep users in the dark about the underlying tech of their products. For normal consumer tech, I can kind of understand, but what astonishes me is that this mindset has extended to aircraft, where the "users" are pilots of commercial aircraft!

The article's quote from a high-ranking boeing official sums it up: the company had decided against disclosing more details to cockpit crews due to concerns about inundating average pilots with too much information—and significantly more technical data—than they needed or could digest.

Re:Boeing Withheld Information on 737 Model, According to Sa... by Hunisgung on Tuesday November 13, 2018 @01:58AM (#18439188)
Telling pilots that when they fly a Boeing, they are always in control and have the last say has been part of Boeing's narrative against Airbus for as long as I can remember.

This might have contributed to their reluctance to talk about adding flight envelope protection features and hiding that even when pilots are "manually" flying, the flight control computers can kick in.

Seems like a reminder that "reality must take precedence over public relations".

Re:Boeing Withheld Information on 737 Model, According to Sa... by jfoutz on Tuesday November 13, 2018 @03:05AM (#18439440)
As crass as it is s/must/should/ . Because clearly it doesn’t.
Re:Boeing Withheld Information on 737 Model, According to Sa... by Neracked on Tuesday November 13, 2018 @03:10AM (#18439462)
That is a quote of Richard Feynman's conclusion to his report on the shuttle Challenger accident: "For a successful technology, reality must take precedence over public relations, for Nature cannot be fooled."
Re:Boeing Withheld Information on 737 Model, According to Sa... by TeMPOraL on Tuesday November 13, 2018 @01:00AM (#18438953)
I agree with you here, though I cannot understand this in "normal consumer tech" either. Most people may not need to know, but a subset of customers does needs to know. People have also incredibly good mental capacity to filter out information not relevant to their needs (as evidenced by continued existence of advertising online).

RE that Boeing quote, I'd really love to know on what research on human mental capacity they based this decision. This is not a snark, I understand that a lot of decisions that go into airplanes are based on solid reasons. This particular doesn't seem to be one, though I'd love to know if I'm wrong about this.

Re:Boeing Withheld Information on 737 Model, According to Sa... by iliketosleep on Tuesday November 13, 2018 @01:17AM (#18439022)
One of Boeing's selling points for this model was that pilots would not need "simulator training beyond that already required for older versions". Disclosing the extra technical information may have invalidated this "no extra training needed!" selling point. In this context, the whole "inundating average pilots with too much information" argument looks more like an excuse.
Re:Boeing Withheld Information on 737 Model, According to Sa... by black-tea on Tuesday November 13, 2018 @01:40AM (#18439121)
That is worrying. Part of the reason the roads are so dangerous relative to the skies and railways is that the people operating those cars are not professional drivers but merely normal people who are barely trained. Has it got to the point where pilots of commercial aircraft are just normal people who can't handle actually knowing how a plane works?
Re:Boeing Withheld Information on 737 Model, According to Sa... by iliketosleep on Tuesday November 13, 2018 @02:25AM (#18439286)
No. Just compare the difficulty of getting a regular driver's license to that of a license to fly commercial airliners. It's safe to say that _almost_ every pilot can control a plane without incident when sensors / automated systems fail, so long as they are given full manual control. Automation overriding pilot inputs during sensor failure is a recipe for disaster.
Re:Boeing Withheld Information on 737 Model, According to Sa... by jakobegger on Tuesday November 13, 2018 @03:14AM (#18439475)
> Automation overriding pilot inputs during sensor failure is a recipe for disaster.

In 2009 an Airbus A330-200 crashed into the Atlantic ocean killing more than 200 people because a confused pilot kept pulling the plane up, despite loud stall warnings from automatic safety systems [1]. In the discussions of that event, one commenter asked, "Why did [the plane] not override the pilots' inputs and force a pitch-down?" [2]

Designing safety critical systems is difficult. If the automated system fails, the pilot needs to be able to take over manual control. But at the same time, if the pilot does something stupid, the automatic system should prevent that.

I'm not sure how to square that.

[1]: https://www.telegraph.co.uk/technology/9231855/Air-France-Fl...

[2]: https://news.ycombinator.com/item?id=8452080

Re:Boeing Withheld Information on 737 Model, According to Sa... by mnw21cam on Tuesday November 13, 2018 @06:16AM (#18440153)
One of the confounding elements of that particular crash was the fact that when the angle of attack increased above a certain (crazy) amount, the stall warnings went away, due to the inability of the system to cope with an angle of attack that high. This confused the pilots into thinking they were going "crazy fast", when actually they were going "crazy slow".
Re:Boeing Withheld Information on 737 Model, According to Sa... by richardkmichael on Tuesday November 13, 2018 @03:00PM (#18444340)
Yes, I point out AF447 as a perfect and horrific example of a problem which is really HCI (human computer interaction) / UX.

The lack of stall warning meant two different things: "not stalling", and "stalling so extremely it can't be sure, so don't report it"; as you say. I wondered if there should be a different sounding alarm for "can't determine". Or, the pitch of stall alarm could rise, such that pilots could tell "which side of the stall" the plane is on, so that entering stall from one side would side start with a very high pitch or very low pitch. (I'd guess there's a better way..)

So, in this case, it's more subtlety more tragic than you describe, because the pilot did correct the AoA, and nose down, but when he did that, the stall warning resumed (albeit from the extreme other "side" of the interval), confusing him: no alarm, alarm resumes, so he thought he "re-stalled" it and he pulled up again. This kept him mentally "stuck" in the extreme stall. They needed to "pass right through" the stall warning window, and come out the other side. They had sufficient altitude for this to succeed.

Re:Boeing Withheld Information on 737 Model, According to Sa... by AstralStorm on Tuesday November 13, 2018 @03:43AM (#18439579)
This is equivalent to a confused deputy variant of a Byzantine failure.

Since you already have allegedly redundant pilots and alarm systems and hopefully sensors, the remaining part is figuring out which failure detector has ultimately failed to work and why. Also if redundant pilots are failing, it's a systematic failure in training, fatal to airlines and whoever designs training simulators.

The most potentially fatal to Boeing scenario is a systematic failure or negligence in terms of redundancy. Hampering pilot training is bad enough. Another potential failure point is a software issue which means negligence in safety critical software engineering.

Re:Boeing Withheld Information on 737 Model, According to Sa... by StreamBright on Tuesday November 13, 2018 @08:34AM (#18440781)
I disagree. Flying a plane is pretty much a simple state machine with very well defined states. We have hundred thousands of flight hours available and we can also build a very realistic simulator which is used extensively to train pilots. It is should not be a challenging task to build a reliable auto-pilot and in fact we have already one that covers most of the aspects of flying. On the top of this, most of the flight related incidents are human errors.
Re:Boeing Withheld Information on 737 Model, According to Sa... by Scramblejams on Tuesday November 13, 2018 @04:01PM (#18444866)
You have been misled concerning the accuracy of simulators. "All models are wrong, some are useful" is a helpful quote to remember here. Certified sims are typically very accurate when it comes to avionics and systems. They are often much less representative where vehicle dynamics are concerned.

Even the most heavily analyzed aircraft can produce surprises once they actually take to the air. Look up "Super Hornet uncommanded wing drop". Or look at dynamic scaling tests (https://www.nasa.gov/pdf/483000main_ModelingFlight.pdf) which uncovered two spin modes in the F-15 that were previously entirely uncharacterized. (Not sure if the linked doc covers that instance specifically -- I learned this from speaking with the study PI. And no, most aircraft programs don't get to do dynamic scaling tests.)

All this is to say that a variety of potential non-linear behavior is lurking inside any given airframe, and all the wind tunnels and CFD in the world will merely allow you to model most of the useful operating conditions, but certainly not all of them.

Simulators, just like autopilots, are useful for finite input ranges. If you leave those input ranges, your simulator will precisely and repeatably model a fantasy, and your autopilot will disconnect.

Source: Short career as an aerospace engineer.

Re:Boeing Withheld Information on 737 Model, According to Sa... by StreamBright on Tuesday November 13, 2018 @06:45PM (#18445964)
And how do you train pilots for these unexpected non-linear events? What stops you to train auto-pilot the same way?
Re:Boeing Withheld Information on 737 Model, According to Sa... by Scramblejams on Tuesday November 13, 2018 @07:10PM (#18446116)
The point of my post was to say that these unexpected events will not come up in your simulated environment, so you simply will not have the data needed to train the autopilot.

The human, by and large, figures it out. We generally accept that risk. But how will the autopilot react to the unexpected event for which you haven't trained it? Who knows?

Re:Boeing Withheld Information on 737 Model, According to Sa... by noselasd on Tuesday November 13, 2018 @12:10PM (#18442612)
It doesn't sound that plausible that we can account for all the various things that can happen to a plane in something as complex as the earths atmosphere with a "simple state machine" . Weather can do really wacky things.
Re:Boeing Withheld Information on 737 Model, According to Sa... by StreamBright on Tuesday November 13, 2018 @02:25PM (#18444002)
You are saying that it is impossible to implement auto-pilot? How does human pilot fly something planes? You think that human mind can deal with infinite states?
Re:Boeing Withheld Information on 737 Model, According to Sa... by nradov on Tuesday November 13, 2018 @03:01PM (#18444352)
Yes the human mind can deal with an effectively infinite number of states (and let's not get into a pointless pedantic discussion about the true meaning of "infinite"). Until we figure out how to build a true AGI then no autopilot will be able to do that.
Re:Boeing Withheld Information on 737 Model, According to Sa... by StreamBright on Tuesday November 13, 2018 @03:36PM (#18444660)
No it can't. Flying an airplane on Earth is a very limited exercise in every possible dimension and it can be easily automated without AGIs.
Re:Boeing Withheld Information on 737 Model, According to Sa... by nradov on Tuesday November 13, 2018 @03:41PM (#18444692)
You're simply wrong and have no idea how flight control actually works. In particular failure modes aren't simple at all; real machines can break in a huge number of ways and no one could possibly predict them all. Recommend you take some actual graduate level aeronautical engineering courses and then reconsider the issue.
Re:Boeing Withheld Information on 737 Model, According to Sa... by StreamBright on Tuesday November 13, 2018 @06:43PM (#18445957)
I am not arguing about how machines can fail, I am arguing for that computers can do things that humans can. Usually with higher precision and much more reliable.
Re:Boeing Withheld Information on 737 Model, According to Sa... by nradov on Tuesday November 13, 2018 @08:55PM (#18446755)
Machines can do some things with higher precision and reliability than humans. Coping with unexpected aircraft failures aren't currently among those things.
Re:Boeing Withheld Information on 737 Model, According to Sa... by Scramblejams on Tuesday November 13, 2018 @04:10PM (#18444927)
noselasd ain't wrong. Autopilots can and do disconnect when the weather conditions exceed their ability. Happens all the time, though probably not often in large airliners because the big carriers have people dedicated to watching the weather and keeping their pilots out of trouble. Your state machine will have to do that, too.
[dead]
Re:Boeing Withheld Information on 737 Model, According to Sa... by StreamBright on Tuesday November 13, 2018 @02:26PM (#18444010)
I know this is why do not have auto-pilot.
Re:Boeing Withheld Information on 737 Model, According to Sa... by chopin on Tuesday November 13, 2018 @03:16AM (#18439483)
The system needs to realize that there is a sensor failure. If the Lion Air crash is due to a faulty sensor Boeing needs to answer some serious questions:

1. Why did they not inform operators about changed system behavior?

2. Why wasn't the system capable of detecting sensor failure and/or act accordingly? In the automation industry one goes to great length to be able to tell good sensors apart from bad ones. Why was that not the case here? If it is not possible to tell bad sensors from good ones, why wasn't there (sufficient) redundancy (=multiple sensors) which at least deactivate the system on conflicting input?

Re:Boeing Withheld Information on 737 Model, According to Sa... by FabHK on Tuesday November 13, 2018 @04:51AM (#18439838)
Re 2:

There are two AoA sensors. However, good question - why aren't there 3 (so you can have majority quorum in case of one failure), and why wasn't automation disabled once a discrepancy between the 2 existing ones was detected?

Re:Boeing Withheld Information on 737 Model, According to Sa... by Zak on Tuesday November 13, 2018 @03:31PM (#18444617)
I've seen a similar failure in a van. The van was equipped with antilock brakes, which override the driver's control input and reduce braking force when the speed sensors on one or more wheels detect that the wheel has stopped too suddenly, as if skidding. One of the sensors had malfunctioned, resulting in an "ABS" warning light, and a fault code readable with a tool indicating which sensor was malfunctioning.

Did it disable the ABS? No. Instead, it continued to rely on the faulty sensor information, activating ABS under moderate deceleration on dry pavement, greatly reducing the available braking force and creating a severe danger.

I think there may be a bias among people designing safety equipment to always try to provide the intended safety benefit, even when part of the system isn't working. The problem is it's easy to lose sight of how the safety feature fits into the overall picture. A pilot can almost always safely fly a plane that doesn't use automation to recover from a stall, but not necessarily one that uses the trim to point the nose at the ground in spite of control inputs to the contrary.

Re:Boeing Withheld Information on 737 Model, According to Sa... by Serow225 on Tuesday November 13, 2018 @11:05AM (#18441974)
Cost.
Re:Boeing Withheld Information on 737 Model, According to Sa... by throw2016 on Tuesday November 13, 2018 @03:51AM (#18439613)
Trains and planes are different transport systems and relative safety records have little to do with the skills of human drivers and more with the nature of the systems.

This 'roads are so dangerous' is part of the self driving crowd scaremongering program. That 'humans can't be trusted' but their tech can obviously.

But when looking at the global picture and the sheer number of cars in all sorts of traffic conditions on roads everyday without incident this narrative falls apart.

We need far more facts, data and critically 'contextualization' than sweeping disingenuous statements by parts of the tech community motivated by self interest and greed.

Re:Boeing Withheld Information on 737 Model, According to Sa... by FabHK on Tuesday November 13, 2018 @04:49AM (#18439830)
> This is part of an unsettling trend where companies prefer to keep users in the dark about the underlying tech of their products

I think for a variety of reasons you cannot equate Boeing with, dunno, tech startups and IoT makers. The history, culture, and regulatory environment in commercial aviation is very different from "normal consumer tech". (In other words, even if there were a superficial similarity here, it would not constitute part of or evidence for some sort of overarching trend affecting both normal consumer trend and commercial aviation.)

Re:Boeing Withheld Information on 737 Model, According to Sa... by Puer on Tuesday November 13, 2018 @07:34AM (#18440454)
How long until Tesla releases an over the air update that changes the behavior of familiar systems and causes an accident?
Re:Boeing Withheld Information on 737 Model, According to Sa... by alistairSH on Tuesday November 13, 2018 @10:49AM (#18441825)
How long until Tesla releases another over the air update that changes the behavior of familiar systems and causes an accident?

FTFY.

Re:Boeing Withheld Information on 737 Model, According to Sa... by threatofrain on Tuesday November 13, 2018 @02:53AM (#18439399)
Now I'm happier than before about the direction of Google's exploit hunting program, and their willingness to report vulnerabilities.