News for hackers. Stuff that matters.
Re:Boeing Starliner updates: Spacecraft flies into wrong orb... by themgt on Friday December 20, 2019 @10:01AM (#21844615)
Boeing's explanation is that the flight automation software runs on some sort of "timer" and the timing apparently wasn't configured correctly, so Starliner thought it was at a different part of the mission and did the wrong burns.

Astonishing to me they make it sound like it runs like an independent stopwatch and not kept in sync with the actual IRL mission parameters in a more direct/continuous way. They're talking about the automation handover between the launch vehicle to the spacecraft, and on Starliner "clearly the time got messed up" ... "the spacecraft was not on the timer we expected it to be on"

Re:Boeing Starliner updates: Spacecraft flies into wrong orb... by lokedhs on Friday December 20, 2019 @10:21AM (#21844772)
Running it on a timer actually works quite well. I don't know how this particular system actually works, but for example the Saturn V launch vehicle handled the initial navigation for several minutes from takeoff by executing previously calculated commands based on launch time, weather conditions etc.

Also, if I have understood things correctly, the lunar lander used a timer based approach to keep the rotation of the vehicle aligned with the surface of the moon as it orbited.

Since the orbital dynamics are very well understood and there really isn't anything that can affect the motion of the spacecraft other than engine burns, there doesn't seem to be any good reason to make it more complicated.

Re:Boeing Starliner updates: Spacecraft flies into wrong orb... by bufferoverflow on Friday December 20, 2019 @12:58PM (#21846019)
> Since the orbital dynamics are very well understood and there really isn't anything that can affect the motion of the spacecraft other than engine burns

This is wrong.

1) Atmospheric drag (unless you're in really high orbits)

2) Wind

3) Uneven gravitational field. Our planet is not a perfect sphere. The moon is even less so.

4) Solar pressure (though very minor and kinda evens out in orbit).

Re:Boeing Starliner updates: Spacecraft flies into wrong orb... by hgoel on Friday December 20, 2019 @01:54PM (#21846505)
The unevenness of the gravitational field on Earth is for the most part ignorable. It isn't like maneuvers are precise enough that one could account for it in the calculations anyway.

Space is empty enough and engines imprecise enough that for orbital stuff you have enough margins to correctly predict and plan a trajectory ahead of time, and just do correction burns later if necessary.

On the Moon the gravitational field is indeed uneven enough to matter, but exactly one orbiter really cares about it (LRO iirc has a specific orbit where the unevenness mostly cancels out), most simply rely on occasional station keeping burns.

Re:Boeing Starliner updates: Spacecraft flies into wrong orb... by beering on Friday December 20, 2019 @01:38PM (#21846402)
Which of these can't you calculate ahead of the launch? Numbers 1, 3, and 4 seem like you could calculate it ahead of time. And maybe number 2 as well, if you do it relatively close to launch time.
Re:Boeing Starliner updates: Spacecraft flies into wrong orb... by nategri on Friday December 20, 2019 @01:47PM (#21846459)
They use models. No model is perfect, they all have uncertainties.
Re:Boeing Starliner updates: Spacecraft flies into wrong orb... by entropicdrifter on Friday December 20, 2019 @02:43PM (#21846815)
Which is why they use pilots too
[dead]
Re:Boeing Starliner updates: Spacecraft flies into wrong orb... by magduf on Friday December 20, 2019 @04:45PM (#21847636)
I'll name two things: 1) Government pay 2) Government shutdowns

But regardless, this was a Boeing spacecraft; it wasn't built by NASA (NASA generally does systems engineering; contractors build things like this).

Re:Boeing Starliner updates: Spacecraft flies into wrong orb... by dgoodell on Friday December 20, 2019 @05:44PM (#21848045)
A government shutdown is a basically surprise paid vacation, as long as you have enough cash to skip a couple paychecks.
Re:Boeing Starliner updates: Spacecraft flies into wrong orb... by BurningFrog on Friday December 20, 2019 @10:29AM (#21844830)
When in stable orbit, I buy that argument.

But many things can go slightly wrong when firing all engines fighting your way up the atmosphere.

Re:Boeing Starliner updates: Spacecraft flies into wrong orb... by lokedhs on Friday December 20, 2019 @11:19AM (#21845224)
That is true. In the Saturn V case, the guidance computer checked the actual location of the spacecraft and issued corrections that had accumulated due to precisely that.
Re:Boeing Starliner updates: Spacecraft flies into wrong orb... by rory096 on Friday December 20, 2019 @11:36AM (#21845355)
Atlas V burn was nominal, this error didn't happen until the capsule was out of the atmosphere.
Re:Boeing Starliner updates: Spacecraft flies into wrong orb... by willis936 on Friday December 20, 2019 @12:40PM (#21845863)
And even more things can go very wrong with more complicated control systems.
Re:Boeing Starliner updates: Spacecraft flies into wrong orb... by natch on Friday December 20, 2019 @12:45PM (#21845893)
>Running it on a timer actually works quite well.

It would seem we have an existence proof now saying that the above statement is incorrect.

Re:Boeing Starliner updates: Spacecraft flies into wrong orb... by pc86 on Friday December 20, 2019 @01:23PM (#21846246)
Let's compare the number of instances a timer has caused an issue and the number of instances it hasn't to determine the actual rate before we make a broad assumption about a field we have no experience in due to a single test case, yes?
Re:Boeing Starliner updates: Spacecraft flies into wrong orb... by natch on Friday December 20, 2019 @03:44PM (#21847235)
Yeah I’m a programmer like most of us here and I’ve seen timers abused quite a lot. They sometimes are appropriate, but more often, they are good examples of an antipattern.

The wording “it would seem” should have tipped you off that no assumptions are being made, but I guess it didn’t work.

And even if we were to make a comparison as you suggest and derive some ratio, that’s not super useful without comparing it to the ratio for some alternative approach that does not use timers.

Re:Boeing Starliner updates: Spacecraft flies into wrong orb... by melq on Friday December 20, 2019 @12:53PM (#21845974)
Because one specific implementation seems to have failed a test run?
Re:Boeing Starliner updates: Spacecraft flies into wrong orb... by TheOtherHobbes on Friday December 20, 2019 @11:47AM (#21845440)
A man-rated launch vehicle failing to reach orbit seems like very good reason.
Re:Boeing Starliner updates: Spacecraft flies into wrong orb... by AWildC182 on Friday December 20, 2019 @12:09PM (#21845615)
The complexity of adding a remote man it the loop creates way more room for error than running a timer. They just fucked up plain and simple.

This is like saying that because the airplane crashed because the wing was incorrectly designed and popped off, everyone should fly biplanes...

Re:Boeing Starliner updates: Spacecraft flies into wrong orb... by dotancohen on Friday December 20, 2019 @03:31PM (#21847144)
> This is like saying that because the airplane crashed because the wing > was incorrectly designed and popped off, everyone should fly biplanes...

We do that. Not with the wings, but with the engines. When jetliner engines were less reliable, we required 3 or more engines on flights that included long sections without passing near an airport (mostly transoceanic flights). Now that some engines are more reliable, we have ETOPS certifications for jetliners using two high-reliablility engines. And yes, there still are two, because no matter how reliable the engines may be, one _may_ fail.

What is backing up that CST-100 timer?

https://en.wikipedia.org/wiki/ETOPS

Re:Boeing Starliner updates: Spacecraft flies into wrong orb... by Jkosmonaut on Friday December 20, 2019 @02:00PM (#21846551)
The man-related launch vehicle worked flawlessly. This was a capsule failure. They’re built by different entities.
Re:Boeing Starliner updates: Spacecraft flies into wrong orb... by unreal37 on Friday December 20, 2019 @12:45PM (#21845899)
It did reach orbit. They're just not at the orbit they want to be at.
Re:Boeing Starliner updates: Spacecraft flies into wrong orb... by Ididntdothis on Friday December 20, 2019 @10:39AM (#21844922)
I thought the space shuttle was the same. They took wind measurements before launch and the ascent was hard coded based on that data.
Re:Boeing Starliner updates: Spacecraft flies into wrong orb... by unreal37 on Friday December 20, 2019 @12:46PM (#21845901)
The Space Shuttle was always hand flown, not automated.
Re:Boeing Starliner updates: Spacecraft flies into wrong orb... by Ididntdothis on Friday December 20, 2019 @12:50PM (#21845947)
Launch was automated. Landing was manual but not for technical reasons.
Re:Boeing Starliner updates: Spacecraft flies into wrong orb... by lokedhs on Friday December 20, 2019 @04:09PM (#21847395)
Didn't they do one automated landing? I seem to remember reading that.
Re:Boeing Starliner updates: Spacecraft flies into wrong orb... by Ididntdothis on Friday December 20, 2019 @07:32PM (#21848675)
They could do it but the pilots wanted something to do so they got to fly manually. The Russians did unmanned launch and landing with their space shuttle Buran.
Re:Boeing Starliner updates: Spacecraft flies into wrong orb... by jczhang on Friday December 20, 2019 @11:19AM (#21845223)
Wind?!
Re:Boeing Starliner updates: Spacecraft flies into wrong orb... by johannes1234321 on Friday December 20, 2019 @11:31AM (#21845307)
Onnplanet earth, where those things are launched their is an atmosphere with wind. That wind impacts where exactly the rocket leaves the atmosphere and deploys the space ship.
Re:Boeing Starliner updates: Spacecraft flies into wrong orb... by spectramax on Friday December 20, 2019 @01:17PM (#21846188)
This is a very disappointing approach I see on HN. Armchair analysis based on sparse information in the article assuming all kinds of things about the avionics, space hardware and rocket physics, condemning an entire team of software engineers that are working on this issue.

Think about this - if you're one of those software engineers and you read some random person on forums criticizing your work without context or thorough understanding, how would you feel?

I love HN for insight and intellectual debate, this kind of analysis does not add any insight - it is flat out dismissing and condescending.

Edit: Also, this behavior against Boeing is unwarranted because it has bias of 737 MAX issues. Completely different team, completely different problem.

Re:Boeing Starliner updates: Spacecraft flies into wrong orb... by paulmd on Friday December 20, 2019 @01:49PM (#21846468)
Yes. For the most part, software engineering is "easy". Find and apply appropriate data structure and algorithm, done. Managing a large legacy codebase and dealing with the soft factors is the hardest part of the job.

This leads to a phenomenon where software engineers tend to come up with "one weird trick to solve the space shuttle, NASA hates him". And it's always specifically software engineers.

Generally, most people are just as competent at their job as you are at yours. If the obvious solution is not being used, there is usually a very good reason why. A lot of fields have problems that are hard for reasons of physics or other things that are not trivially gone around, and the solution is not one software engineer swooping in with a great idea that totally revolutionizes avionics.

(sometimes of course it is social factors, same as software engineering. The best way is too expensive, or management is making bad decisions, etc)

Re:Boeing Starliner updates: Spacecraft flies into wrong orb... by bumby on Friday December 20, 2019 @04:58PM (#21847740)
The jump to simple solutions in hindsight bothers me. Especially with software in complex safety-critical systems it's often incredibly hard to capture all the permutations that can lead to a failure mode.

I wouldn't doubt most programmers could do an failure mode effects analysis on the software and figure out they need to mitigate an event where the timer fails to sync. But how many would also capture how to mitigate that sync failure at the precise time the system lost satellite comm? Probably a heck of a lot less.

Now multiply that by the total number of software failure modes (including those latent ones we just get lucky with) and see how many get captured. There's a reason why software in these types of systems is incredibly hard to test.

Re:Boeing Starliner updates: Spacecraft flies into wrong orb... by perl4ever on Friday December 20, 2019 @08:16PM (#21848891)
This problem is software engineering, isn't it? How are you defining it?
Re:Boeing Starliner updates: Spacecraft flies into wrong orb... by magduf on Friday December 20, 2019 @04:48PM (#21847659)
>this behavior against Boeing is unwarranted because it has bias of 737 MAX issues. Completely different team, completely different problem.

Wrong. Do you somehow thing there's a different management team running these parts of the company? There's only one CEO at Boeing, it's only one company. And culture starts at the top.

Questioning Boeing's competence here is entirely warranted when the company has already PROVEN that it is happy to put profits ahead of safety.

Re:Boeing Starliner updates: Spacecraft flies into wrong orb... by travisporter on Friday December 20, 2019 @03:18PM (#21847061)
I would wager that even if you find the one guy/girl who made this timer error, the decision to not use other sensors, other failsafes was probably made by a higher-up or a team.
Re:Boeing Starliner updates: Spacecraft flies into wrong orb... by bumby on Friday December 20, 2019 @05:01PM (#21847750)
It's usually driven by system safety analysis criteria. E.g., if a timer failure is categorized as "catastrophic" it may be required to have X amount of redundancy. The amount of redundancy defined by 'X' may be driven by customer (i.e. NASA) requirements.
Re:Boeing Starliner updates: Spacecraft flies into wrong orb... by lancewiggs on Friday December 20, 2019 @02:19PM (#21846683)
Culture is culture. The 737 Max issues relate to the 787 battery issues relate to this. Is the company run by safety-first oriented aeronautical engineers or not.
Re:Boeing Starliner updates: Spacecraft flies into wrong orb... by perl4ever on Friday December 20, 2019 @08:16PM (#21848886)
"Completely different team, completely different problem"

It...seems sort of similar to me, based on the article I read. It's not similar at all in the consequences, because of the context of the flight. But in the way things went wrong.

A question that I have unanswered is, Boeing was reported as saying that if there were astronauts they would be "safe"...but would it be possible to retrieve them?

Re:Boeing Starliner updates: Spacecraft flies into wrong orb... by spectramax on Friday December 20, 2019 @10:04PM (#21849321)
The problem is that there is ample press and experts who have scrutinized the 737-MAX issues for over 8 months now - there were multiple systematic/organizational issues and oversights all over the place - that should be duly criticized and it was, but let's learn about this other issue in a completely different division (Space), take hints and jump to conclusions about their incompetence. This is immature, condescending and disrespectful of the engineers that worked on making this happen.

SHIT happens in space flight all the time. The rate at which shit happens in space is on a few orders of magnitude different than shit that happens in commercial aerospace. Ask how many times SpaceX failed to do what they do today and it will fail more times in future, no doubt.

I also understand the company culture point - yea, company culture probably isnt the best at Boeing but they've done many many things right in past decades. They're a huge company with a lot of talented engineers (and a lot of bozos). Their CEO is a complete asshat and I am sure people inside Boeing talk about it.

I just think that there is unnecessary scrunity without data to say definitively what happened.

Re:Boeing Starliner updates: Spacecraft flies into wrong orb... by perl4ever on Friday December 20, 2019 @10:38PM (#21849429)
I don't jump to conclusions about "incompetent engineers" in either case, so it doesn't affect my opinion of the similarity.
Re:Boeing Starliner updates: Spacecraft flies into wrong orb... by jjuhl on Friday December 20, 2019 @01:51PM (#21846487)
If you are actually on the team, you shouldn't be reading HN or any other random internet forum to try and get accurate feedback on your work in the first place.
Re:Boeing Starliner updates: Spacecraft flies into wrong orb... by spectramax on Friday December 20, 2019 @02:06PM (#21846593)
That's besides the point - I was just making a remark that how would they "feel". Not saying at all about whether they should looking around on the internet for feedback.
Re:Boeing Starliner updates: Spacecraft flies into wrong orb... by throwaway_se099 on Friday December 20, 2019 @05:25PM (#21847925)
> Armchair analysis based on sparse information

That's internet in a nutshell, and HN is not that different despite pretensions to the contrary. What partly redeems it is the better than even chance that in posts with technical subjects, someone informed and/or competent will appear and write something worthy. You learn to filter out the rest.

Re:Boeing Starliner updates: Spacecraft flies into wrong orb... by spookthesunset on Friday December 20, 2019 @03:38PM (#21847190)
Agree. HN is getting full of people with some serious chips on their shoulder. Any article with the words "Amazon", "Boeing", "Google", or "Facebook" in it will be flooded with, to be blunt, a bunch of garbage posts. Not a good insightful, intellectual discussion. Just people with massive chips on their shoulders flooding the comments with noise.
Re:Boeing Starliner updates: Spacecraft flies into wrong orb... by scottlocklin on Friday December 20, 2019 @02:59PM (#21846924)
>Think about this - if you're one of those software engineers and you read some random person on forums criticizing your work without context or thorough understanding, how would you feel?

Who gives a shit how he feels? He works at a company that builds death traps, and someone at that company has built one himself. People like this should feel overpowering shame and contemplate the poor life choices that brought them to this terrible place.

Boeing is a great argument for the corporate death penalty. Its stock price should go to zero, and its assets divided between its creditors and the military pieces nationalized.

Re:Boeing Starliner updates: Spacecraft flies into wrong orb... by hoorayimhelping on Friday December 20, 2019 @12:46PM (#21845906)
>Flight controllers recognised the problem but were unable to intervene quickly enough because the capsule was passing between satellite links.

I imagine the reason timers are used is this right here. We don't have complete coverage of the earth for satellite control, so there needs to be a timer running for when it can't phone home to stay synchronized.

Re:Boeing Starliner updates: Spacecraft flies into wrong orb... by mkagenius on Friday December 20, 2019 @11:51AM (#21845469)
> flight automation software runs on some sort of "timer"

Interesting, this might explain the failure to land the rover (vikram) on the dark side of the moon by India's recent moon mission.

For example, what if the altitude assumed by the timer is off by a few kilometers, and it starts operating in a manner which is for landing within few meters.

Re:Boeing Starliner updates: Spacecraft flies into wrong orb... by hgoel on Friday December 20, 2019 @01:57PM (#21846525)
Landings are not generally done like that though. A landing would be basically impossible without active guidance, due to it being a far more precise maneuver than in-orbit maneuvers.
Re:Boeing Starliner updates: Spacecraft flies into wrong orb... by rasz on Saturday December 21, 2019 @07:44PM (#21854331)
Sensors, especially redundant ones, are expensive. Ask Boeing Max engineers.