Test flights are a very different beast. Early tests can be expected to fail; some are supposed to fail ("destructive testing"). Explosions and other failures become much more concerning later in the process; for example, Boeing's Starliner's latest test flight was supposed to demonstrate everything was working correctly. It failed to do so.
In the two Starship launches so far, SpaceX was very clear with expectations in advance. Each likely has dozens of objectives. The second flight very clearly accomplished more than the first; a successful test of the launchpad mitigations, a successful test of all first-stage engines staying lit, a successful test of separation, a successful test of the second-stage engines all lighting, etc.
But now an explosion is an expected outcome for your million dollar hardware.
That approach works in software dev.
A test starship is nowhere near that, though we don't have exact numbers. Probably closer to $100 million.
Also SpaceX is trying to solve a much harder problem. If you would have asked that Saturn team "Also, land all the stages of the rocket", the likely answer you would have got is "Screw off, you're insane" or "Give me 100 billion dollars".
The fuck? NASA lost people in production hardware multiple times.
https://en.wikipedia.org/wiki/Apollo_1
https://en.wikipedia.org/wiki/Apollo_6 "The damaged third-stage engine failed to restart for trans-lunar injection... Despite the engine failures, the flight provided NASA with enough confidence to use the Saturn V for crewed launches..."
https://en.wikipedia.org/wiki/Apollo_13
https://en.wikipedia.org/wiki/Space_Shuttle_Challenger_disas...
https://en.wikipedia.org/wiki/Space_Shuttle_Columbia_disaste...
Here's a fun one: They tested the Saturn crew escape system. The booster was supposed to blow up, and demonstrate the crew would survive... but the test went wrong, and it blew up early, when it shouldn't have. The crew abort worked, so test failed successfully.
> Apollo 1, initially designated AS-204, was planned to be the first crewed mission of the Apollo program.
The "accidental abort test" was launched on a Little Joe II, a simple single-stage solid rocket motor, not a Saturn of any variety. This booster was unrelated to any Saturn hardware.
If the Starship second stage failed to restart causing it to fail to get to TLI, or tried to take out its manned crew like 13 did, you’d be claiming it’s still a sterling safety record?
You’d have considered this test a success if it reached orbit “despite sustaining severe damage” on the way up?
Come on.
> Every crewed launch of the Saturn V was a success
Fine. Same for Starship, so far.
“My hunch is that whatever happens, we'll see scenes of Apollo people clapping and cheering and Apollo fans calling the flight a success. From what they tell me, no Apollo launch has ever failed.”
b) The Apollo program actually cost not just money, but human lives = a much worse outcome than just losing a test rocket. And Apollo 13 crew was very lucky to have returned to Earth alive.
c) Losses of test hardware can only really be somewhat prevented by being extremely careful and pedantic during development, which takes time, and guess what? More time spent obsessing about every single detail = more money spent on development. It is entirely possible that the "hardware is expendable" approach is much cheaper than what you would like to have.
If that last category doesn't succeed that doesn't mean the test flight was a "failure" from the businesses perspective. They still got what they wanted, they just didn't get the icing on top.
The test flight that destroyed the pad is properly categorized as a failure. The flight termination system was expected to work. They expected not to cause that much damage to their infrastructure and surroundings, their relationship with the FAA, their ability to get licenses, etc. To argue that it wasn't a failure, you have to argue that the flight termination system was in the category of systems where a failure was considered acceptable. If that was the case, everyone involved in launching that flight ought to to go jail for recklessly endangering the public.
The most recent test flight though seems to have been a pretty resounding success. Everything that they said they really wanted to see happen, happened. Yes, both stages had failures in "we might not even get here" test objectives after that. That's ok.
Demonstrably incorrect.
Examples:
https://www.youtube.com/watch?v=AqeJzItldSQ is a Saturn launch abort test that failed. It failed in a way that they were able to determine that intended test would have worked, though. 1:20 for the meat of things.
https://en.wikipedia.org/wiki/Apollo_6 also failed to achieve its objectives; "Despite the engine failures, the flight provided NASA with enough confidence to use the Saturn V for crewed launches; a potential third uncrewed flight was cancelled."
All that aside, SpaceX was quite clear that the latest Starship test had multiple objectives, and that "successfully splashdown near Hawaii" was deemed quite unlikely. It successfully demonstrated a number of items, including fairly critically the launchpad changes. It wasn't one test; it was a bunch of tests in one flight.
The success criteria for integrated launch test 1 was to clear the launch pad (which it nearly destroyed) test 2 was get past the stage seperation, which it did.
Spacex have a very fast cadence for tests and seem not to make the same error twice. The best test environment is really trying to fly the ship.
They have not a stable platform, but will be testing advanced features?
This program is starting to take queues from its soviet ancestor.
Launch one really was a comedy of errors in the launch platform.
In launch 2 the booster did exactly what every other booster by everyone else (except the falcon 9) does. Got it's payload to the target altitude before separation.
The second stage reached space.
The N1 platform didn't do any of that.
You have no idea what a testing platform looks like, and are too used to NASA one shot rockets that cost 3 billion each just to make sure nothing goes wrong.
The second stage exploded as well, possibly because of FTS, possibly not (was it ever confirmed?).
SpaceX clearly has a winning method, as they have a success rate of 99.3% and hold the record for most consecutive successful launches at 253. Second place is Soyuz-U, which had 112 consecutive successful launches and an overall success rate of 97.3%. SpaceX has more consecutive successful booster landings (173) than any space program has had successful launches.
It exploded while attempting to test its landing maneuver. If it just turned off the engines and dropped itself into the ocean like a normal booster, it likely would not have exploded (for one thing, there wouldn't be any fuel left in it being saved for landing).
A few people have slosh modeled the booster flip around duplicating observed speeds and accelerations and surmise the following. The flip around was too rapid causing slosh to one size of the booster. In addition there was negative acceleration that would have allowed the remaining fuel to experience zero gees pulling it away from the bottom of the rocket. When the engines fired back up it would have hit the bottom of the rocket with something between 20 and 100 tons of force. Based on SpaceX description, the FTS was not used.
The second stage at least appears to be oxygen leakage. The graphs shown on flight day started showing a more rapid depletion of oxygen after second stage lighting. SpaceXs language was something like 'flight was unable to reach orbital insertion and was terminated, pointing to the FTS being used.
This sounds wasteful on paper, but in practice it is much much faster and amazingly enough cheaper. With traditional rockets you never make enough to enjoy economies of scale, but with SpaceX's approach they've dropped the cost of the engine by about an order of magnitude over just a few years, and it was already a very inexpensive engine. For the cost of a single RS-25 you can buy 400 Raptors.
Multiple iterations of test flights that are expected to fail is a much faster way to develop impressive tech than spending 3x longer doing on the ground analysis of every detail of everything because you can't bear the PR hit of something that can be painted as a failure.
The refueling team might be ready to test, even though the "don't explode" team are still working on it.
There are some great documentaries about the NASA team that does safety critical software: https://www.youtube.com/watch?v=iJNNJxC12UM