News for hackers. Stuff that matters.
Re:FAA lifted National Ground Stop at 0119Z by sjs382 on Friday November 13, 2026 @08:32PM (#50492619)
ATCSCC Advisory ATCSCC ADVZY 005 DCC 11/14/2026 CNX NATIONWIDE GROUND STOP MESSAGE:

EVENT TIME: 14/0116 - 14/0130 DESTINATION AIRPORT:ALL FACILITIES INCLUDED: ALL EXPECT UPDATE:0400Z REASON: REMARKS: THE FAA COMMAND CENTER NATIONWIDE GROUND STOP HAS BEEN CANCELLED. EFFECTIVE TIME:

140119-140200 SIGNATURE:

26/11/14 01:19

Re:FAA lifted National Ground Stop at 0119Z by aschla on Friday November 13, 2026 @08:45PM (#50492709)
Re:FAA lifted National Ground Stop at 0119Z by isatty on Friday November 13, 2026 @08:50PM (#50492746)
Do we have any indication of what went wrong? The incident report will be very interesting.
Re:FAA lifted National Ground Stop at 0119Z by pryanbengt on Friday November 13, 2026 @08:52PM (#50492768)
Transportation secretary saying that their networking routers were being overloaded by increased communications traffic. But its not a cyberattack or software failure.

Speculation on my part, they just rolled out their SMART air traffic routing system. https://www.flyingmag.com/faa-smart-ai-now-active-at-22-artc...

Bet the increased strain on data polling from this system is the culprit for increased traffic.

Re:FAA lifted National Ground Stop at 0119Z by cozzyd on Friday November 13, 2026 @08:56PM (#50492798)
Sounds like a software failure to me.
Re:FAA lifted National Ground Stop at 0119Z by TZubiri on Friday November 13, 2026 @09:42PM (#50493195)
maybe, what is confirmed is that they were trying to upgrade some physical TDM switches with IP routers (as they have been doing for a while), and the "new systems overwhelmed the old ones".

It is possible that this overwhelming was caused by a software or configuration error, no doubt.

I think that if that's the case, rather than failing upwards and going for a full simultaneous upgrade with a 50B congress bill, the brakes should be stepped on a little bit, continue the partial migration as long as there are no issues. Or at least wait until the start of a 4year administration to go for a rehaul, so that you can stay around if things go fubar.

Re:FAA lifted National Ground Stop at 0119Z by Willish42 on Friday November 13, 2026 @09:10PM (#50492911)
They just said in the press conference that it couldn't possibly be related to SMART, since the systems were disconnected, but the timing and lack of a concrete answer as to the cause or likely cause, combined with asking for money from congress (which currently has a republican majority...) for "more modern infrastructure" has me doubting their version of events
Re:FAA lifted National Ground Stop at 0119Z by pryanbengt on Friday November 13, 2026 @09:17PM (#50492959)
I acknowledge this is borderline conspiracy. Sec Mullen's statement is that FAA was quote "installing new equipment, new technology and that the new equipment new technology was overwhelming the system"

Transportation secretary Duffy says that the smart system is unrelated. That the smart system is a dashboard for displaying all the data from across the air traffic system. My questions is obviously where is the smart system getting its data from...

I suspect FAA pushed for the new AI system, didnt take into account the increased traffic demand to feed the system. Aging infra isnt sufficient to handle the increased demand. Now Duffy is trying to deflect blame unto someone else.

Re:FAA lifted National Ground Stop at 0119Z by larntz on Friday November 13, 2026 @09:41PM (#50493187)
I kept waiting for someone to ask what the source of the traffic that overwhelmed the legacy systems was...

Should be an easy answer. We saw increased traffic from X and we've implemented Y to ensure it doesn't happen again.

Instead it was vague hand waving around old hardware and funding.

Even if they don't have all the details organized, what was done to fix the problem? How was the 12b spent thus far and what where does the additional 50b number come from?

Or maybe don't start with demanding money. What happened? How was it fixed? What is being done to ensure it doesn't happen again? Then mention this shit needs fixed and we'll be working with Congress for additional funding.

It was interesting that Mullen mention new technology contributing at one point. Sounds like someone made a mistake somewhere and this press conference was purposefully vague or they really don't understand what happened yet (doubtful).

Plenty of critical systems operate reliably on old tech as long as you work within the limitations.

This press conference had maybe 30s of actual info and the rest was this antiquated system is fucked even though it's been working for years and the only way to move forward is $50b. :shrug:

Re:FAA lifted National Ground Stop at 0119Z by not_kurt_godel on Friday November 13, 2026 @10:17PM (#50493419)
> I kept waiting for someone to ask what the source of the traffic that overwhelmed the legacy systems was

They did hurriedly mention it was "new patches" in the midst of their deranged ranting and finger-pointing (at...their own party, a point Duffy was visibly taken aback by when told by a reporter). When they vehemently insisted it was 'not SMART' one has to presume they meant that the hasty execution of their haphazard AI rollout was performed unintelligently.

Re:FAA lifted National Ground Stop at 0119Z by rhipitr on Friday November 13, 2026 @09:53PM (#50493255)
Was this rolled out on a Friday?
Re:FAA lifted National Ground Stop at 0119Z by evilfred on Friday November 13, 2026 @08:52PM (#50492758)
Palantir / L3Harris
Re:FAA lifted National Ground Stop at 0119Z by CodeCompost on Friday November 13, 2026 @08:51PM (#50492754)
A botched update, allegedly.
Re:FAA lifted National Ground Stop at 0119Z by pvab3 on Friday November 13, 2026 @08:51PM (#50492755)
L3Harris Update
Re:FAA lifted National Ground Stop at 0119Z by willio58 on Friday November 13, 2026 @09:12PM (#50492926)
my buddy used to work at L3Harris. It sends shivers down his spine whenever i mention it.
Re:FAA lifted National Ground Stop at 0119Z by willio58 on Friday November 13, 2026 @09:12PM (#50492927)
my buddy used to work at L3Harris. It sends shivers down his spine whenever i mention it. He's gonna love when I dog him on this one.
Re:FAA lifted National Ground Stop at 0119Z by not_kurt_godel on Friday November 13, 2026 @08:53PM (#50492775)
In the press briefing (https://www.nytimes.com/live/2026/11/13/us/ground-stop-natio...) it was just stated that new "patches" "overwhelmed" the "legacy system". Sounds to me like the new SMART AI rollout went haywire.
Re:FAA lifted National Ground Stop at 0119Z by hysan on Friday November 13, 2026 @08:55PM (#50492792)
At the press conference (current, live), they are blaming old hardware that is failing. They’re in an endless loop of repeatedly saying that it’s Congress’s fault for lack of funding and that this is the result of old hardware. I just gave up on watching because they aren’t saying anything informative.
Re:FAA lifted National Ground Stop at 0119Z by ChaseRensberger on Friday November 13, 2026 @08:59PM (#50492828)
i misread this as saying you were in attendance of the conference and was hype that the press uses hackernews
Re:FAA lifted National Ground Stop at 0119Z by donalhunt on Friday November 13, 2026 @09:01PM (#50492846)
Re:FAA lifted National Ground Stop at 0119Z by hysan on Friday November 13, 2026 @09:02PM (#50492859)
Ah sorry for the misleading writing. My brain has been fried trying to work while also trying to dig up any useful info to help my wife who is stranded at the airport figure out what to do. I usually can last longer watching press conferences but this one was… just painful. Maybe someone else can give an update if they actually talk about what’s going on.
Re:FAA lifted National Ground Stop at 0119Z by ChaseRensberger on Friday November 13, 2026 @09:06PM (#50492883)
ive also been watching it, pretty much repeating the same stuff

> old system give us money

> probably not a cyberattack btw

> not SMART related

> we've opened the airspace but this is gonna be slow

just ended actually as i was typing this, that's pretty much it

Re:FAA lifted National Ground Stop at 0119Z by sjs382 on Friday November 13, 2026 @09:09PM (#50492905)
> Maybe someone else can give an update if they actually talk about what’s going on.

They didn't.

Re:FAA lifted National Ground Stop at 0119Z by aorloff on Friday November 13, 2026 @08:57PM (#50492809)
The press should be asking why this could be the case when the GOP has held congress and the white house for two years ? Just what was the party in charge thinking ?
Re:FAA lifted National Ground Stop at 0119Z by moogly on Friday November 13, 2026 @08:56PM (#50492800)
I'm used to bizarre press conferences from this administration but this is something else. Just baffling.
Re:FAA lifted National Ground Stop at 0119Z by reactordev on Friday November 13, 2026 @09:02PM (#50492856)
[delayed]
Re:FAA lifted National Ground Stop at 0119Z by moogly on Friday November 13, 2026 @09:15PM (#50492948)
"It's the safest system in the world, I mean, uh, except that it's horribly outdated with switches from the 80s and radars from the 70s, so we really need 50 billion dollars from congress STAT or we're in big trouble, but it's completely safe. Also Congress needs to give Trump the Builder this money _now_. We couldn't get it in the past couple of years even though we controlled the entire government. I mean, sure, we got 12 billion, but that's not enough to unfuck what Joe Biden did. Your loved ones are completely safe by the way, but we can't promise this won't happen again."
Re:FAA lifted National Ground Stop at 0119Z by dalyons on Friday November 13, 2026 @10:57PM (#50493728)
It’s amazing we aren’t all dead, given how stunningly incompetent these people are
Re:FAA lifted National Ground Stop at 0119Z by reactordev on Saturday November 14, 2026 @08:04AM (#50496715)
I'm sure they couldn't figure out the process of procedures required to really inflict harm so they went after immigrants based on their data. Following a data trail with Claude is easier than actually governing.
Re:FAA lifted National Ground Stop at 0119Z by budman1 on Friday November 13, 2026 @09:23PM (#50493006)
I think the supplemental appropriation that the FAA got as part of the OBB is probably too big to be spent. Unless you just hand it all to a contractor, it takes time and oversight to spend billions. Legally and practically.
Re:FAA lifted National Ground Stop at 0119Z by g-b-r on Friday November 13, 2026 @09:06PM (#50492889)
and the journalists haven't yet picked up the actual reason that they revealed among the lines
Re:FAA lifted National Ground Stop at 0119Z by Avicebron on Friday November 13, 2026 @09:01PM (#50492850)
Having worked in Government for a spell. Are we actually sure that old hardware isn't the problem?
Re:FAA lifted National Ground Stop at 0119Z by hysan on Friday November 13, 2026 @09:06PM (#50492885)
I didn’t say it isn’t. Just that they aren’t really giving any details and more importantly, they aren’t giving info for what people who are stranded should be doing right now. (And now that I’ve settled down a bit, it’s odd that if it’s old hardware failing, how is it suddenly not failing? Was it just some systems, did they have replacements, or if it’s what the other commenters wrote, then did they just turn off the AI updates to stop overloading the hardware? Which would mean that hardware is fine. It’s just underprovisioned.)
Re:FAA lifted National Ground Stop at 0119Z by Avicebron on Friday November 13, 2026 @09:09PM (#50492908)
I'm being a little bit tongue in cheek, I'm sorry your wife is stranded.

I expect it to be a combination of extremely poorly funded and sidelined IT infrastructure trying to use a bloated AI system from a hype company. Which results in everything breaking and poor schmucks already at the end of their rope working to fix something they barely understand.

Re:FAA lifted National Ground Stop at 0119Z by arcfour on Friday November 13, 2026 @09:16PM (#50492956)
It sounds like it has nothing to do with AI at all. Why does everyone keep jumping to AI when there's no indication this has anything to do with AI?
Re:FAA lifted National Ground Stop at 0119Z by Avicebron on Friday November 13, 2026 @09:21PM (#50492995)
Because everyone [in the specific field of technical professional operating systems like this] is using AI and not everyone is smart about how they use AI?
Re:FAA lifted National Ground Stop at 0119Z by gamblor956 on Friday November 13, 2026 @09:40PM (#50493170)
System worked mostly fine for decades, then in the middle of integrating a new AI system it completely goes down.

It doesn't take a genius to see the problem is the new AI system. Whether or it's the "AI" part of the system isn't really relevant system this new system was vibe-coded by AI and built around the "AI" features.

Re:FAA lifted National Ground Stop at 0119Z by phil21 on Friday November 13, 2026 @09:53PM (#50493258)
There is zero evidence of this at all. The stuff going around on social media has zero correlation to the system in question. Unless you have other evidence others are not privy to?
Re:FAA lifted National Ground Stop at 0119Z by arcfour on Friday November 13, 2026 @11:15PM (#50493854)
Do you understand what the AI system does? It suggests routes for air traffic controllers to use. It does not replace anything or automate anything. It is a read only system. The company behind it already confirmed that the outage had nothing to do with said system ("of course they'd say that," no, not really...)

And the actual culprit was telecommunications related...

Re:FAA lifted National Ground Stop at 0119Z by qntmfred on Friday November 13, 2026 @09:41PM (#50493183)
AI is the name of the witch that everybody is so eager to burn
Re:FAA lifted National Ground Stop at 0119Z by phil21 on Friday November 13, 2026 @09:52PM (#50493250)
> I expect it to be a combination of extremely poorly funded

Highly doubt this. Unless you mean sort of like education in many areas where the system is robustly funded but the money doesn't actually reach the people doing the work on the ground.

Re:FAA lifted National Ground Stop at 0119Z by Avicebron on Friday November 13, 2026 @09:55PM (#50493267)
> where the system is robustly funded but the money doesn't actually reach the people doing the work on the ground.

Yeah of course I mean this, I mean the guy who had to serial connect to whatever shit show was running and was sitting there trying to parse error logs.

Re:FAA lifted National Ground Stop at 0119Z by budman1 on Friday November 13, 2026 @09:21PM (#50492991)
Hardware can be fixed. Even if it is old. Spares exist for a reason. Maintenance staff exists for a reason.
Re:FAA lifted National Ground Stop at 0119Z by lovecg on Friday November 13, 2026 @09:26PM (#50493032)
Up to a point. If your equipment is decades old, spare parts and expertise is a quickly diminishing resource.
Re:FAA lifted National Ground Stop at 0119Z by budman1 on Friday November 13, 2026 @09:31PM (#50493088)
Not with the budget the FAA has to apply to the problem. Yes, you have a point. But the importance of this system could get circuit boards manufactured to old drawings. Specific 'electronics boxes' replaced with new ones designed to replace the antiquated hardware.

FAA has been doing this for decades. A single electronics box, or even a couple should not drop the system. Maybe for the time it takes to remove and replace.

After hearing the press conference "some new stuff was plugged in and the legacy system could not handle it" or alternatively 'a mistake was made that just so happens involved non today equipment, but we want more money'

Re:FAA lifted National Ground Stop at 0119Z by db48x on Friday November 13, 2026 @09:24PM (#50493017)
> they aren’t giving info for what people who are stranded should be doing right now.

Do you really need the government to solve that problem for you? Just book another flight.

Re:FAA lifted National Ground Stop at 0119Z by simonw on Friday November 13, 2026 @09:26PM (#50493033)
Good luck "just booking another flight" when half a million people are trying to do exactly the same thing at the same time as you.
Re:FAA lifted National Ground Stop at 0119Z by db48x on Friday November 13, 2026 @10:30PM (#50493524)
Well, sure, that goes without saying. You just don’t need the government to tell you what to do; you can work it out yourself.
Re:FAA lifted National Ground Stop at 0119Z by linkjuice4all on Friday November 13, 2026 @09:08PM (#50492899)
It's certainly possible - but for whatever reason this administration (with the help of that guy from the robot taxi company) seems to not like air traffic controllers and has been trying to find ways around them.

It's possible this is the standard "privatize a government function and skim the profits" move but some of this stinks of union busting and trying to reduce the amount of influence air traffic controllers have whenever the organized criminals that run our government want to have a shutdown but keep their private jets flying.

Suffice it to say - there's no reason to trust any of these people when it comes to taking care of critical government functions.

Re:FAA lifted National Ground Stop at 0119Z by wpietri on Friday November 13, 2026 @09:30PM (#50493077)
Given that the old hardware has been around a long time without a problem like this, it seems very odd to blame the old thing for the new problem. My money is on a poorly planned transition, one where they didn't take the old hardware seriously enough.
Re:FAA lifted National Ground Stop at 0119Z by snailmailman on Friday November 13, 2026 @09:07PM (#50492895)
They were also insisting its not a problem with the new upgrades they were installing, but one of them slipped up and said something along the lines of the "new hardware overwhelmed the old hardware" which seems like the real issue.

Not sure if this was the the exact quote, but I see AP wrote, "introduction of some new technology into an old air traffic control system overwhelmed it." Despite that, the whole conference, on loop, they were insisting that the problem is entirely the old hardware and this is why they need billions to overhaul it and rebuild from scratch.

Re:FAA lifted National Ground Stop at 0119Z by g-b-r on Friday November 13, 2026 @09:19PM (#50492977)
"What it appears to be right now is as secretary Duffy and FAA was going in and putting patches into the system, they were putting new equipment, new technology, and, that new equipment new technology it was overwhelming the older system"
Re:FAA lifted National Ground Stop at 0119Z by nerevarthelame on Friday November 13, 2026 @09:29PM (#50493067)
I assume that this was a boring, routine update that went awry.

But my completely unfounded and more conspiratorial theory, based on zero knowledge of air traffic control systems, is that to better accommodate SMART, L3Harris was strong-armed into to rolling out a hastily written patch on a Friday, which accidentally took down the system.

Re:FAA lifted National Ground Stop at 0119Z by TZubiri on Friday November 13, 2026 @09:35PM (#50493124)
>but one of them slipped up and said something along the lines of the "new hardware overwhelmed the old hardware" which seems like the real issue.

The secretary also mentioned that the new system should be brought altogether, and not piece by piece. Which would lend credence to an incompatibility between both systems.

Re:FAA lifted National Ground Stop at 0119Z by voncheese on Friday November 13, 2026 @09:17PM (#50492963)
Not only was there a lack of useful information (other than the fact that the grounding was lifted), it was an astounding demonstration of poor leadership during a crisis. No ownership, no focus on the problem/root cause/next steps.
Re:FAA lifted National Ground Stop at 0119Z by readthenotes1 on Friday November 13, 2026 @09:20PM (#50492981)
I'm pretty sure saying that Congress needs to give them the money to replace the ancient hardware is putting ownership directly where it belongs and identifying the problem, the root cause, and the next steps.

What am I missing?

Re:FAA lifted National Ground Stop at 0119Z by voncheese on Friday November 13, 2026 @09:24PM (#50493015)
In the moment of crisis, they own the problem of making the system work with what they have.

As a postmortem, once the dust has settled, is the time to ask for more funding/support

Re:FAA lifted National Ground Stop at 0119Z by lukan on Friday November 13, 2026 @09:26PM (#50493038)
That if the ancient hardware was working and just the new software they tried to put on it did not worked with that hardware - it still means they messed up.
Re:FAA lifted National Ground Stop at 0119Z by kQq9oHeAz6wLLS on Friday November 13, 2026 @10:43PM (#50493619)
You forgot to blame Trump. What are you, new here?
Re:FAA lifted National Ground Stop at 0119Z by jhallenworld on Friday November 13, 2026 @09:22PM (#50493004)
Let's be clear: it was bunch of idiot political hacks being unbelievably obsequious to Trump. So embarrassing for the country. The ask for for $50B is clearly a request for more grift for their friends.
Re:FAA lifted National Ground Stop at 0119Z by selectodude on Friday November 13, 2026 @09:29PM (#50493072)
Markwayne the plumber correcting a reporter for saying AI instead of SI instead of answering the question was utterly surreal.
Re:FAA lifted National Ground Stop at 0119Z by dfxm12 on Friday November 13, 2026 @09:34PM (#50493118)
This is one of the reasons for the "SI" mandate.
Re:FAA lifted National Ground Stop at 0119Z by skeeter2020 on Friday November 13, 2026 @10:07PM (#50493354)
I thought you were being a jerk, but no this dude has an Associate in Applied Science in plumbing from the Oklahoma State University Institute of Technology. Huh.
Re:FAA lifted National Ground Stop at 0119Z by selectodude on Friday November 13, 2026 @10:25PM (#50493488)
Don’t even get me started on the one nobody gave a shit about on Real World: Boston standing at a podium and demanding $50 billion.
Re:FAA lifted National Ground Stop at 0119Z by dalyons on Friday November 13, 2026 @10:53PM (#50493692)
How are we all not dead? These people are clearly stunningly incompetent
Re:FAA lifted National Ground Stop at 0119Z by hn_throwaway_99 on Friday November 13, 2026 @09:31PM (#50493091)
Sec Duffy's presentation was just embarrassing. Blame anybody else except for the people in charge.
Re:FAA lifted National Ground Stop at 0119Z by eddythompson80 on Friday November 13, 2026 @09:41PM (#50493176)
Usually I refuse to give any detailed postmortem right after an incident is mitigated/resolved until I have had a chance to collect my thoughts and make sure I have had a chance to write a clear problem/root cause/next steps. The communication that goes out with the mitigation signal is often short and vague and the detailed postmortem follows a day or so later.
Re:FAA lifted National Ground Stop at 0119Z by indstinctdialog on Friday November 13, 2026 @09:17PM (#50492965)
Have they even thanked the pilots, air traffic cobteollers and thousands of airport personnel for handling the mahyhem?
Re:FAA lifted National Ground Stop at 0119Z by mjcl on Friday November 13, 2026 @09:19PM (#50492978)
No, but they made sure to thank the Dear Leader several times each.
Re:FAA lifted National Ground Stop at 0119Z by fch42 on Friday November 13, 2026 @09:55PM (#50493270)
There's still time for that. The mayhem is ongoing and will be felt for days. I hope by Monday a few "bosses" will say thanks to all the staff who ran overtime to deal with desperate grounded passengers, do all the rebooking snd schedule changes.
Re:FAA lifted National Ground Stop at 0119Z by BigBlackGorilla on Friday November 13, 2026 @09:28PM (#50493055)
We need a despot that will ignore all bureaucratic bloat and get things done, quite frankly. Otherwise this country is done for. Spiraling into the trash can.
Re:FAA lifted National Ground Stop at 0119Z by jquery on Friday November 13, 2026 @09:30PM (#50493085)
That’s what Trump was supposed to be. Turns out it’s way less efficient than having someone who’s good at working with other people.
Re:FAA lifted National Ground Stop at 0119Z by wholinator2 on Friday November 13, 2026 @11:11PM (#50493823)
Right? Absolutely flabbergasting hearing this _while trump is in office, after 2 years of controlling all three branches_. I remember hearing this as a justification for looking past trumps obvious faults and deficiencies. To hear it said now seems almost satirical.
Re:FAA lifted National Ground Stop at 0119Z by BigBlackGorilla on Saturday November 14, 2026 @09:20AM (#50497229)
Trump is a centrist clown who has been a democrat his entire life until his republican grift
Re:FAA lifted National Ground Stop at 0119Z by Fordec on Friday November 13, 2026 @09:50PM (#50493237)
They are trying desperately to not name the AI system that got turned on yesterday that they commissioned.

Is it more likely that decades old hardware failed coincidentally or that the first rollout of a new tech went wrong within a number of hours because the test environment didn't have sufficiently scaled load testing?

Re:FAA lifted National Ground Stop at 0119Z by superkuh on Friday November 13, 2026 @08:57PM (#50492806)
So they were doing a network upgrade and putting in new equipment. This new equipment was misconfigured and caused the existing working system to stop working. And now they are saying in the press briefing that this is a problem of the existing working system which they call the "legacy system" and are using this as a political move to call for the congress the regime no longer controls to provide funding to the FAA/DHS. Framing the manufactured issue they caused with the new system as if it was congress' problem instead of their own breakage they caused and are deflecting from. Demanding an emergency funding bill now despite ignoring it in all the years they were in control.
Re:FAA lifted National Ground Stop at 0119Z by zzzeek on Friday November 13, 2026 @09:00PM (#50492832)
There is an actual bill for $50B that's been stalled for months in the Senate called the Modern Skies Act, and there is absolutely widespread antiquation within the US air infrastructure which this bill seeks to address. So he's not just making this up. He's talking about exactly that bill albeit with all the Trump BS injected into it.
Re:FAA lifted National Ground Stop at 0119Z by loceng on Friday November 13, 2026 @09:06PM (#50492882)
Mentioning how they previously received $15B but nothing improved - so why will any further money allocated actually end up where it's meant to go?
Re:FAA lifted National Ground Stop at 0119Z by starkparker on Friday November 13, 2026 @09:06PM (#50492887)
Modern Skies Act is for $30B, not $50B. A separate $12.5B from "Big Beautiful" is already being spent on ATC modernization, and only $10B of MSA is toward ATC

https://www.transportation.gov/sites/dot.gov/files/2026-09/M...

Re:FAA lifted National Ground Stop at 0119Z by lostlogin on Friday November 13, 2026 @09:25PM (#50493028)
The One Big Beautiful Bill Act cracks me up as even the naming was shortsighted and defective.
Re:FAA lifted National Ground Stop at 0119Z by zzzeek on Friday November 13, 2026 @09:32PM (#50493100)
Thanks, I corrected it, 3's and 5's get mixed up for me due to my synesthesia giving them the same color
Re:FAA lifted National Ground Stop at 0119Z by SonOfKyuss on Friday November 13, 2026 @09:10PM (#50492909)
Sure, but blaming Democrats when they’ve controlled Congress and the presidency for the past two years and their highest priority has been cutting funding via DOGE is pretty disingenuous
Re:FAA lifted National Ground Stop at 0119Z by zzzeek on Friday November 13, 2026 @09:33PM (#50493110)
Their press conference was horrendous but it seemed he was just blaming Congress overall and not Democrats specifically (since it is Republicans actually holding it up)
Re:FAA lifted National Ground Stop at 0119Z by qlte on Friday November 13, 2026 @09:25PM (#50493029)
Assuming I'm looking at the right bill (S. 5572, the Modern Skies Act), "stalled for months" seems a tad overstated considering it was introduced Sep 25th 2026, just three days before Congress went on recess for the entire month of October (elections). The Senate wasn't back in session until Nov 9th, so the bill has been pending for a grand total of seven in-session days.

The Senate will be in session for four more days next week before the Thanksgiving holiday, and then back for the first three weeks of December before the 119th Congress adjourns for good on Dec 18th.

So basically, after two full years with control of both branches of Congress and the WH, this bill was introduced on the very last week of the regular Congress calendar. After which the lame duck Congress would only meet for about four weeks until adjournment.

Not really stalled, more like procrastinated until days before the election, hoping that the lame duck Congress (notoriously unproductive period generally) would force it through in a rush? Doesn't seem like a great strategy if they actually wanted it to pass.

Re:FAA lifted National Ground Stop at 0119Z by firesteelrain on Friday November 13, 2026 @09:11PM (#50492918)
It’s possible the interfaces to the legacy system aren’t documented well and/or it could be incompetence on behalf of the network engineers working this
Re:FAA lifted National Ground Stop at 0119Z by larntz on Friday November 13, 2026 @09:54PM (#50493263)
Agreed, but why not just say that?

Maybe things are moving fast today and they didn't have time to understand and communicate accurately, but at some point soon I think we deserve a more in depth explanation.

Re:FAA lifted National Ground Stop at 0119Z by firesteelrain on Friday November 13, 2026 @10:18PM (#50493433)
Waiting for the RCCA
Re:FAA lifted National Ground Stop at 0119Z by solfox on Friday November 13, 2026 @08:59PM (#50492829)
Soon enough, you'll be hearing calls to privatize the FAA for "efficiency" due to "failures" like this.
Re:FAA lifted National Ground Stop at 0119Z by morkalork on Friday November 13, 2026 @09:04PM (#50492871)
The beast is starving and thrashing about
Re:FAA lifted National Ground Stop at 0119Z by donalhunt on Friday November 13, 2026 @09:00PM (#50492838)
The sceptics will say Trump caused the outage so the FAA get approved for the $50B they claim to need to replace the air traffic control system.
Re:FAA lifted National Ground Stop at 0119Z by lostlogin on Friday November 13, 2026 @09:28PM (#50493058)
That would imply there was a plan. A series of predictable events baffle this administration, so assuming a nefarious plan would seem extreme.
Re:FAA lifted National Ground Stop at 0119Z by TZubiri on Friday November 13, 2026 @09:02PM (#50492853)
My hypothesis is that there is a PE firm that is buying up multiple ISPs with regional monopolies and pushing copper wire routers into CGNAT to commercialize the recouped IPv4 blocks, this is causing TCP servers to become unreachable even with port forwarding, and the ISPs are functionally taking that opportunity in order to upsell clients into fiber optic systems, which effectively solves the issue. Big picture what the ISPs are doing is purposefully breaking client systems and charging money in order to restore service.

It's farfetched, but if it's true, pretty sure I'm the first to posit it. If it ends up being that, feel free to write to me for more info or an interview on how I knew.

Re:FAA lifted National Ground Stop at 0119Z by sjs382 on Friday November 13, 2026 @09:03PM (#50492867)
Summary from the press conference: Unclear what happened but they have old equipment. Only Duffy can fix it and he needs $50B from Congress to do it. They can't guarantee it won't happen again.
Re:FAA lifted National Ground Stop at 0119Z by budman1 on Friday November 13, 2026 @09:23PM (#50493013)
Only Donald can fix it. Pay attention.
Re:FAA lifted National Ground Stop at 0119Z by Animats on Friday November 13, 2026 @09:10PM (#50492912)
Not much info yet. Even ops.group [1], which is for people who do flight planning, has nothing yet.

LAX hasn't restarted yet. Departures are either "Cancelled" or "Delayed".

All information about this is from PR teams. Nothing from reporters who cover airports. Nobody from airport management, airline operations, FAA operations people, or somebody who just got off shift at a control tower. People who might actually know something. There was a briefing at the White House, and it was all cabinet secretaries. "Instead of reassuring an anxious public, and providing concrete information, this briefing appears to be intended for President Trump’s approval" wrote a New York Times reporter.

FAA policy prohibits anybody but PR people talking to the public. The details of that policy are not public.[2]

[1] https://www.ops.group/blog

[2] https://www.faa.gov/regulations_policies/orders_notices/inde...

Re:FAA lifted National Ground Stop at 0119Z by efficax on Friday November 13, 2026 @09:22PM (#50492999)
you’ll never get a proper retro for this, it’s too political
Re:FAA lifted National Ground Stop at 0119Z by nycdatasci on Friday November 13, 2026 @09:24PM (#50493021)
Yesterday's Headline: "The FAA Is Rolling Out Its AI Air Traffic Tool Nationwide" https://gizmodo.com/the-faa-is-rolling-out-its-ai-air-traffi...
Re:FAA lifted National Ground Stop at 0119Z by superkuh on Friday November 13, 2026 @08:54PM (#50492781)
So they were doing a network upgrade and putting in new equipment. This new equipment was misconfigured and caused the existing working system to stop working. And now they are saying in the press briefing that this is a problem of the existing working system which they call the "legacy system" and are using this as a political move to call for the non-MAHA congress to fund the DHS more.
Re:FAA lifted National Ground Stop at 0119Z by debrisontrack on Friday November 13, 2026 @08:55PM (#50492795)
This felt at best like "we'll fix it in prod" situation.
Re:FAA lifted National Ground Stop at 0119Z by souvlakee on Friday November 13, 2026 @08:57PM (#50492807)
The reason field is empty, but the website footer provides enough information to understand.
Re:FAA lifted National Ground Stop at 0119Z by g-b-r on Friday November 13, 2026 @09:00PM (#50492835)
And yet, it seems to have been a careless update to have broken everything
Re:FAA lifted National Ground Stop at 0119Z by cozzyd on Friday November 13, 2026 @09:02PM (#50492862)
probably updating winzip
Re:FAA lifted National Ground Stop at 0119Z by g-b-r on Friday November 13, 2026 @09:05PM (#50492874)
yeah, maybe with a vibecoded replacement
Re:FAA lifted National Ground Stop at 0119Z by bombcar on Friday November 13, 2026 @09:23PM (#50493011)
They tried to register it
Re:FAA lifted National Ground Stop at 0119Z by mathgeek on Friday November 13, 2026 @09:34PM (#50493117)
Shoulda used winrar.
Re:FAA lifted National Ground Stop at 0119Z by MadVikingGod on Friday November 13, 2026 @09:01PM (#50492841)
Ahh the great Kubernetes cluster in the sky finally finished reconciling and got the new nodes up and running. I bet this time it only took 3 faxes and 9 different signatures from heads of the redundant departments of redundancy.
Re:FAA lifted National Ground Stop at 0119Z by 0xBA5ED on Friday November 13, 2026 @09:08PM (#50492901)
Reason: "A bunch of smart guys made it a long time ago and nobody knows how it works"
Re:FAA lifted National Ground Stop at 0119Z by cosmicgadget on Friday November 13, 2026 @09:44PM (#50493206)
We fired the remaining smart people two years ago, choosing loyalty as the only retention criteria.
Re:FAA lifted National Ground Stop at 0119Z by speransky on Friday November 13, 2026 @09:09PM (#50492903)
Found stack of 3.5” floppies and rolled back
Re:FAA lifted National Ground Stop at 0119Z by nan60 on Friday November 13, 2026 @09:09PM (#50492904)
Per AP: "Mullin said the introduction of some new technology into an old air traffic control system overwhelmed it."

So it was the AI?

Re:FAA lifted National Ground Stop at 0119Z by mjmsmith on Friday November 13, 2026 @09:21PM (#50492994)
MARKWAYNE MULLIN: We call it SI around here, remember, SI.
Re:FAA lifted National Ground Stop at 0119Z by __MatrixMan__ on Friday November 13, 2026 @09:36PM (#50493135)
SI? No thanks. My car gets 40 rods to the hogshead and that's just the way I likes it.
Re:FAA lifted National Ground Stop at 0119Z by eichin on Friday November 13, 2026 @09:42PM (#50493197)
"we" being him (ie. not the reporter) because he's part of the executive branch; that's the limit of the authority of the executive order, after all...
Re:FAA lifted National Ground Stop at 0119Z by The_Blade on Friday November 13, 2026 @09:26PM (#50493030)
yes but we need to upgrade to SMART Ultra
Re:FAA lifted National Ground Stop at 0119Z by jamesbfb on Friday November 13, 2026 @09:29PM (#50493068)
If this is indeed the case, this event should be used as an argument for load tests as part of test suites in software.
Re:FAA lifted National Ground Stop at 0119Z by cyrus-is on Friday November 13, 2026 @09:41PM (#50493188)
I mean, it’s not like there’s established processes for doing this that have been around for 30 years
Re:FAA lifted National Ground Stop at 0119Z by iamleppert on Friday November 13, 2026 @09:09PM (#50492906)
They need $50 billion to give to Accenture according to the latest press release
Re:FAA lifted National Ground Stop at 0119Z by downrightmike on Friday November 13, 2026 @09:17PM (#50492962)
And they'd still be using the sliding nameplate system from the 1960's
Re:FAA lifted National Ground Stop at 0119Z by teaearlgraycold on Friday November 13, 2026 @09:11PM (#50492916)
Doesn’t it feel wrong to anyone else that there’s a single point of failure for all fights in the US? I can understand if there are regional zones and the East coast gets grounded. But everything at once??
Re:FAA lifted National Ground Stop at 0119Z by __MatrixMan__ on Friday November 13, 2026 @09:33PM (#50493109)
Is it a bad idea? Absolutely. But also it's to be expected. People like to have a single point of control. You can't do that without introducing single points of failure.

I wish more was being done on partition tolerance. Consistency is over rated.

Re:FAA lifted National Ground Stop at 0119Z by jaza on Friday November 13, 2026 @09:35PM (#50493123)
I didn't know we could stop all fights in the US. Tell me more!
Re:FAA lifted National Ground Stop at 0119Z by shusaku on Friday November 13, 2026 @09:56PM (#50493276)
I guess if you consider safety the top priority, you might let a local failure pause the whole system. So I’m not sure quite how much to criticize this point
Re:FAA lifted National Ground Stop at 0119Z by j4k0bfr on Friday November 13, 2026 @10:02PM (#50493322)
It's a miracle that US air traffic control isn't having incidents like this more often. Admiral Cloudberg has a great write-up [1] that touches on some of the systemic problems in American aviation, oh boy it's a mess.

[1] https://admiralcloudberg.medium.com/reaping-the-whirlwind-in...

Re:FAA lifted National Ground Stop at 0119Z by jfengel on Friday November 13, 2026 @10:10PM (#50493380)
Given that many flights are between regions, it makes sense to me that you would need a nationwide system. Even a flight within a region may depend on a plane or crew coming in from another one.

Having it degrade into regional systems would be a nice property, but risks making a complex system more complex. Put all of your eggs in one basket and then make sure it's a really good basket.

Re:FAA lifted National Ground Stop at 0119Z by bl4ckneon on Friday November 13, 2026 @09:12PM (#50492925)
"we don't need a rollback plan, what could possibly go wrong..." -Probably someone at the FAA
Re:FAA lifted National Ground Stop at 0119Z by willio58 on Friday November 13, 2026 @09:14PM (#50492941)
"Just fix forward" - Sean Duffy, the reality TV star from the 90s turned... U.S. Secretary of Transportation

Who could have seen that coming?

Re:FAA lifted National Ground Stop at 0119Z by g-b-r on Friday November 13, 2026 @09:16PM (#50492957)
https://youtube.com/watch?v=Mh2q-y0wIu8&t=3540s

"What it appears to be right now is as secretary Duffy and FAA was going in and putting *patches* into the system, they were putting new equipment, new *technology*, and, that new equipment new technology it was overwhelming the older system".

So, it was a careless update, probably the one deploying their new 875 millions AI tool.

And no journalist at the conference picked that up.

Re:FAA lifted National Ground Stop at 0119Z by interestica on Friday November 13, 2026 @10:24PM (#50493480)
Bro was fighting for his life to not say AI:

"They were putting new equipment um and uh new um......technology"

Re:FAA lifted National Ground Stop at 0119Z by elicash on Friday November 13, 2026 @09:18PM (#50492971)
Here's what they said caused it in the White House briefing:

Sec Mullin: What it appears to be right now is, as Sec Duffy and FAA was going in and putting patches into the system, they were putting new equipment and new technology. And that new equipment and new technology, it was overwhelming the older system. Which is why Sec Duffy made it very clear, the patchwork doesn't work. We need one complete system.

Re:FAA lifted National Ground Stop at 0119Z by kuviaq on Friday November 13, 2026 @09:25PM (#50493026)
Re:FAA lifted National Ground Stop at 0119Z by jordanb on Friday November 13, 2026 @09:31PM (#50493092)
Seems kinda nuts to replace "obsolete" switched telephone circuit technology that's incredibly reliable and zero latency with VoIP.
Re:FAA lifted National Ground Stop at 0119Z by ajkjk on Friday November 13, 2026 @09:39PM (#50493157)
... no it doesn't?
Re:FAA lifted National Ground Stop at 0119Z by OhMeadhbh on Friday November 13, 2026 @09:40PM (#50493168)

   Sure, but the purpose of the tech policy office is to
   argue why old systems (which have fixed maintenance costs)
   should be replaced with new systems which goose the
   economy when the federal government pays 10x for what they
   should be paying.
Re:FAA lifted National Ground Stop at 0119Z by jzemeocala on Friday November 13, 2026 @09:56PM (#50493278)
reminds me of the fact that (for some reason) it costs thousands of bucks to replace or install a stop sign.....even in rural FL
Re:FAA lifted National Ground Stop at 0119Z by lelandfe on Friday November 13, 2026 @10:21PM (#50493448)
Let's say I'm a rural FL-servicing contractor the city uses. What strikes you as the right amount to pay to get a stop sign installed, cost of goods included? It's probably a two man job.
Re:FAA lifted National Ground Stop at 0119Z by mitxela on Saturday November 14, 2026 @06:42AM (#50496217)
Consider the minimum expenditure for anything is going to be a crew of at least three people for at least a full day, how would you do it for less than a thousand?
Re:FAA lifted National Ground Stop at 0119Z by xmprt on Friday November 13, 2026 @09:41PM (#50493179)
Not really. The problem with keeping old technology is that you need people who have knowledge of how to maintain the old systems. Ignoring the cynical view that many of those people were likely fired, even if they were kept on, they will eventually retire. There's no amount of training that can replace that institutional knowledge.

If and when things break you'll end up with an even bigger disaster if you don't have people prepared to maintain the old systems. A well managed decommissioning and upgrade is much more preferable.

Re:FAA lifted National Ground Stop at 0119Z by dmix on Friday November 13, 2026 @09:48PM (#50493230)
> Ignoring the cynical view that many of those people were likely fired

FAA has 45k employees. Around 2% were laid off in 2025 (around 1,600), most of which were new probationary employees or voluntary retirements. They've been hiring since then so the better question is were the subset of people who left the critical factor or some other leadership failure.

Re:FAA lifted National Ground Stop at 0119Z by sippingabonedry on Friday November 13, 2026 @10:23PM (#50493474)
> Ignoring the cynical view that many of those people were likely fired

In your mind maybe. Most are dead or retired.

New techs have been trained on splicing fiber and VoIP over the last two decades.

Nobody knows about vacuum tubes anymore either, that doesn't mean they were fired and their pensions taken away.

Re:FAA lifted National Ground Stop at 0119Z by sippingabonedry on Friday November 13, 2026 @10:12PM (#50493392)
It is obsolete.

The parts to maintain the legacy infrastructure are no longer manufactured and they are cannibalizing parts for spares.

Not to mention the expertise for these systems have either retired or in some cases passed away.

My grandparents still have a landline and the number of outages in the last 12 months has been insane. Some were in excess of a week.

Many such cases.

Re:FAA lifted National Ground Stop at 0119Z by nbaugh1 on Saturday November 14, 2026 @08:13AM (#50496768)
It’s funny, this is basically an exact analogy for the situation that my software engineering team has been in for at least 5 years now.

For various reasons the team got to a point where lots of the core services were running on totally obsolete technology. I’m talking CoffeeScript here, Python 2.7 there.

Over time, enough turnover and changes happened that they had a pile of repos where not only were the developers on the team unable/uninterested in working on the ancient tech, it was impossible to hire anyone skilled in those areas.

So we ported the features of the legacy services into a modern stack and are STILL working on getting the last of our customers migrated 2 years later. The legacy services are still up but only 2 of us really know a single thing about them, much less re-deploy them if something goes down. Documentation and run-books are great but hands on experience can be really hard to replace in the worst situations

Re:FAA lifted National Ground Stop at 0119Z by sippingabonedry on Saturday November 14, 2026 @09:18PM (#50503337)
It really isn't, and here's why.

Software environments can more easily be recreated/emulated, especially with VMs being ubiquitous.

With hardware, it's sometimes impossible to recreate. The chips are out of production. The tooling was destroyed and doesn't exist anymore. It's on a whole other level.

Re:FAA lifted National Ground Stop at 0119Z by dnqthao on Friday November 13, 2026 @09:28PM (#50493059)
I don't understand why they did not test this before deploying on production. How can we sure that when they develop a whole new system, it will work?
Re:FAA lifted National Ground Stop at 0119Z by ChrisMarshallNY on Friday November 13, 2026 @09:36PM (#50493134)
> I don't always test my code; but when I do, I do it in production.

https://static.wingify.com/gcp/uploads/abtasty/test-in-produ...

Re:FAA lifted National Ground Stop at 0119Z by OhMeadhbh on Friday November 13, 2026 @09:37PM (#50493141)

   Because if it doesn't work, they call it out for bids
   again, select their cronies and get kickbacks.  If it does
   work, then they've missed an opportunity for grift.
Re:FAA lifted National Ground Stop at 0119Z by OhMeadhbh on Friday November 13, 2026 @09:50PM (#50493242)

   Lol.  Down-voted by people who work for government
   contractors.
Re:FAA lifted National Ground Stop at 0119Z by Jtsummers on Friday November 13, 2026 @09:58PM (#50493283)
[delayed]
Re:FAA lifted National Ground Stop at 0119Z by OhMeadhbh on Saturday November 14, 2026 @12:21PM (#50498770)

   But apparently  they don't downvote people  for commenting
   on people commenting on downvoting.
Re:FAA lifted National Ground Stop at 0119Z by sippingabonedry on Friday November 13, 2026 @10:08PM (#50493365)
No you are being downvoted for abusing monospaced font for attention.
Re:FAA lifted National Ground Stop at 0119Z by dfc on Friday November 13, 2026 @10:40PM (#50493584)
They use monospace a lot. I wish there was a way to flag someone for it.
Re:FAA lifted National Ground Stop at 0119Z by mitxela on Saturday November 14, 2026 @06:41AM (#50496207)
there is, it's a button called "flag" in little gray text above the comment if you are on the comment's page.

If you meant to report the user, you have to email [email protected]. They don't bite but they don't always do the thing you wanted.

Re:FAA lifted National Ground Stop at 0119Z by OhMeadhbh on Saturday November 14, 2026 @12:20PM (#50498748)

   What about flagging people for using proportional fonts for
   attention?  Seems vaguely arbitrary.
Re:FAA lifted National Ground Stop at 0119Z by dfxm12 on Friday November 13, 2026 @09:40PM (#50493163)
This admin can't be trusted with lining a pool. Why is their incompetence still a surprise to you after all this time?
Re:FAA lifted National Ground Stop at 0119Z by dboreham on Friday November 13, 2026 @09:53PM (#50493257)
Let's set that aside and instead ask why tf they rolled out anything on a Friday? Or was it that they rolled it out on Tuesday but failed to notice it was close to overload state until it actually overloaded on Friday?
Re:FAA lifted National Ground Stop at 0119Z by kasey_junk on Friday November 13, 2026 @10:14PM (#50493403)
Or it was Friday traffic that overloaded it.
Re:FAA lifted National Ground Stop at 0119Z by golbanno on Friday November 13, 2026 @09:55PM (#50493264)
Sounds like the new system effectively performed a DoS on the old system. They probably don't have a development environment where they can hook the two systems up. Even if they do, it might actually have been an out-of-the-way component that failed first, impacting another, and so on. If they have a test environment with the two systems, a complex failure like that would unlikely to be found (and would explain why it took hours to resolve).
Re:FAA lifted National Ground Stop at 0119Z by pknomad on Friday November 13, 2026 @09:58PM (#50493292)
As someone who works under a different umbrella in the federal government, how do you propose testing something so archaic and complex without replicating an exact replica of a 40+ YO technology?
Re:FAA lifted National Ground Stop at 0119Z by AnneTrotter on Friday November 13, 2026 @10:00PM (#50493315)
I've actually worked a system where the test env was scavenged old eq set up to mirror exactly the ancient prod env. It's possible, it just takes a lot of work. Scaling it might be touchy though.
Re:FAA lifted National Ground Stop at 0119Z by pknomad on Friday November 13, 2026 @10:04PM (#50493337)
> It's possible, it just takes a lot of work

Not only it takes lot of work, but to have the replica connect to the prod in some way to mirror identical behavior will possibly mean adjusting ATO, which is not a simple process in itself.

Re:FAA lifted National Ground Stop at 0119Z by dwattttt on Friday November 13, 2026 @10:30PM (#50493528)
And it sounds like the fault conditions only occur when you do scale up.
Re:FAA lifted National Ground Stop at 0119Z by madaxe_again on Sunday November 15, 2026 @05:02AM (#50505592)
That’s obviously not true.
Re:FAA lifted National Ground Stop at 0119Z by nik282000 on Friday November 13, 2026 @10:03PM (#50493330)
Emulate, computing is cheap. In an application as important as air traffic control it seems like it wold be worth it to _always_ have a working copy of the original system specifically for testing changes.
Re:FAA lifted National Ground Stop at 0119Z by kasey_junk on Friday November 13, 2026 @10:14PM (#50493399)
You think an error that brings down _national_ networks is something you can emulate?
Re:FAA lifted National Ground Stop at 0119Z by pknomad on Friday November 13, 2026 @10:18PM (#50493430)
Thank you, you get it.
Re:FAA lifted National Ground Stop at 0119Z by cgio on Friday November 13, 2026 @10:32PM (#50493543)
Not aware of specific system, but critical infrastructure systems have a quality assurance system that replicates production albeit not perfectly. You may replicate the core system but not all its interfaces, you might replicate it but scaled down etc. There are ways for solid tests to fail. For systems with downtime, a test on production is useful iif you have solid rollback procedures. There’s lots of art in the operation of these systems.
Re:FAA lifted National Ground Stop at 0119Z by pwndByDeath on Friday November 13, 2026 @10:08PM (#50493366)
Its possible, just not probable with who you can hire for gov work.
Re:FAA lifted National Ground Stop at 0119Z by dnqthao on Friday November 13, 2026 @10:56PM (#50493724)
If you cannot replicate everything then maybe have a very conservative rollout approach so that if it fails, it only affect a small subset of the traffic.
Re:FAA lifted National Ground Stop at 0119Z by ncr100 on Saturday November 14, 2026 @07:20AM (#50496460)
That's sounding like a good idea, simulate using a RTOS.
Re:FAA lifted National Ground Stop at 0119Z by indstinctdialog on Friday November 13, 2026 @10:32PM (#50493540)
I’m sure it worked on his machine.
Re:FAA lifted National Ground Stop at 0119Z by jmyeet on Friday November 13, 2026 @11:02PM (#50493780)
The Secretary of Transportation's claim to fame is having been on MTV's the Real World and being a sycophant. Is it really that shocking? Really? We live in the dumbest timeline.

I'll be interested to see what the root cause of this all is, assuming it doesn't get buried. What I find both perplexing and predictable is how the finger has been pointed at Congress for not funding a replacement. Well, who's controlled Congress for the last 2 years? Who was president in 2017-2021? Who controlled Congress in 2017 and 2018?

If you want to dig deeper, this administration has also (unsuccessfully thus far) claimed in court that they're not bound by Congress when it comes to spending under the Impoundment Control Act.

Re:FAA lifted National Ground Stop at 0119Z by hn_throwaway_99 on Friday November 13, 2026 @09:29PM (#50493065)
I can't tell if you're being ironic or not. Sure, "one complete system", and I want a pony.

I watched Sec Duffy's presentation, and it was appalling, but par for the course with this administration: in the middle of a major nationwide outage, he tried to blame someone else.

Even if Duffy got everything he wished for, how do you think they would upgrade a system as old and complicated as ATC. They would have to do it piecemeal anyway. This was a classic upgrade that broke shit. The problem was with the new upgrade, not the old shit that worked.

Re:FAA lifted National Ground Stop at 0119Z by elicash on Friday November 13, 2026 @09:38PM (#50493151)
I was just presenting the full quote from the Secretary of Homeland Security explaining what went wrong. I wasn't commenting on it. I added quotation marks to make it more clear.

I do agree with your view.

Re:FAA lifted National Ground Stop at 0119Z by hn_throwaway_99 on Friday November 13, 2026 @09:53PM (#50493256)
Oh, my apologies, I had originally read the last 2 sentences in your voice. Thanks for the update.
Re:FAA lifted National Ground Stop at 0119Z by AndrewKemendo on Friday November 13, 2026 @09:29PM (#50493069)
This is only one of many recent “lip sores” indicating the a herpes virus that is all over US critical infrastructure.

Over a decade ago I was an intelligence officer and the alarm bells were going off and it was exceptionally clear to the National security community that US infrastructure is barely holding on.

Clapper in 2013:

https://nsarchive.gwu.edu/document/21491-document-90

Dan Coates in 2018:

https://www.euronews.com/2018/07/13/us-intel-chief-warns-of-...

Tip of the iceberg folks. Hold on to your butts…

Re:FAA lifted National Ground Stop at 0119Z by kQq9oHeAz6wLLS on Friday November 13, 2026 @10:39PM (#50493582)
But somehow it's this administration's fault.
Re:FAA lifted National Ground Stop at 0119Z by wpm on Friday November 13, 2026 @11:27PM (#50493925)
In this particular case? Yes, very much so.

Both things can be true: US infrastructure is in a dire place AND this monumental acute unforced fuck up is the fault of the unqualified, corrupt people who were put in charge of it

Re:FAA lifted National Ground Stop at 0119Z by kilroy123 on Saturday November 14, 2026 @08:15AM (#50496784)
It certainly does give strong "The Empire is Falling" vibes.
Re:FAA lifted National Ground Stop at 0119Z by drehm on Friday November 13, 2026 @09:31PM (#50493089)
Duffy also kept saying they were working as quickly as they possibly could trying to rollout the new system. Not exactly reassuring.

I think the problem with a lot of the push to "modernize" is we forget the legacy system has been real-world tested for 40 years now. It's the new stuff that needs to prove itself in terms of stability.

Re:FAA lifted National Ground Stop at 0119Z by Taek on Friday November 13, 2026 @10:14PM (#50493402)
We have a rule in my dev shop: if a piece of code (or hardware) has been working without fault in production, you do not touch it. It doesn't matter if it's old, if you don't like the tests, if it's in a programming language you despise; if there haven't been any problems in production, you don't touch it.
Re:FAA lifted National Ground Stop at 0119Z by soulofmischief on Friday November 13, 2026 @10:22PM (#50493462)
What about legitimate issues?
Re:FAA lifted National Ground Stop at 0119Z by lanyard-textile on Friday November 13, 2026 @10:26PM (#50493495)
That's the exception they noted ;)

> if a piece of code (or hardware) has been working without fault in production

Re:FAA lifted National Ground Stop at 0119Z by dwattttt on Friday November 13, 2026 @10:30PM (#50493520)
And then you have the common reality: "a piece of code has been working in production with known faults & known costs". And you have to weigh up costs and risks.
Re:FAA lifted National Ground Stop at 0119Z by Taek on Friday November 13, 2026 @11:15PM (#50493851)
Well yes of course. If there are bugs or issues in prod (performance/scale), then code can be updated or replaced.

But we have tons of legacy code that our engineers don't like, yet it runs fine and has run fine for years.

Re:FAA lifted National Ground Stop at 0119Z by Terr_ on Friday November 13, 2026 @10:32PM (#50493539)
[delayed]
Re:FAA lifted National Ground Stop at 0119Z by SoftTalker on Friday November 13, 2026 @10:45PM (#50493628)
This is exactly the way we operated Crystal Reports. "If it works, don't touch it"
Re:FAA lifted National Ground Stop at 0119Z by winrid on Sunday November 15, 2026 @08:12AM (#50506702)
Hi! I built a competitor to you for motorsports partially so I didn't have to deal with the output of Crystal Reports and have been migrating customers. Good luck tho
Re:FAA lifted National Ground Stop at 0119Z by hardaker on Friday November 13, 2026 @10:50PM (#50493674)
Especially on a Friday. The 13th doubly so.
Re:FAA lifted National Ground Stop at 0119Z by newswasboring on Friday November 13, 2026 @10:52PM (#50493688)
Sure if you don't like the tests you can write more tests, no? Tests are not production. Am I missing something?
Re:FAA lifted National Ground Stop at 0119Z by Taek on Friday November 13, 2026 @11:16PM (#50493860)
In some cases the testing frameworks cause CI headaches
Re:FAA lifted National Ground Stop at 0119Z by jiggawatts on Friday November 13, 2026 @10:54PM (#50493705)
That’s the wrong attitude.

This thinking caused an extended outage for the biggest mobile network in Australia: https://www.telstra.com.au/exchange/some-mobile-calls-and-da...

Those pair of boxes nobody was brave enough to touch cost them AUD 30 million in fines.

Re:FAA lifted National Ground Stop at 0119Z by jmyeet on Friday November 13, 2026 @11:14PM (#50493848)
I haven't read anything to suggest the root cause was similar. As far as I've seen Telstra operated in a way very much the opposite of the FAA and ATC. A reboot of a GPS module propagated the wrong time via NTP to the network. An audit said Telstra didn't treat the correct time as a critical capability (you know, with backups and such).
Re:FAA lifted National Ground Stop at 0119Z by jiggawatts on Friday November 13, 2026 @11:24PM (#50493911)
They had redundancy! Both appliances that "always worked" stopped working.

In my mind, anything that's not under continuous maintenance immediately begins to suffer from bit-rot and degrades steadily over time.

Of course, that's not a degradation of digital media, but the "dropping out" of concepts out of people's minds.

This is akin to Netflix's Chaos Monkey approach: systems under constant change and attack necessarily become robust. Systems untouched under glass like something in a museum are typically fragile and crumble if so much as breathed on.

Confidence comes from practice, not ignorance.

Re:FAA lifted National Ground Stop at 0119Z by mitxela on Saturday November 14, 2026 @06:39AM (#50496197)
This happened because the GPS module was outdated.
Re:FAA lifted National Ground Stop at 0119Z by HumblyTossed on Saturday November 14, 2026 @10:14AM (#50497676)
> That’s the wrong attitude.

Not necessarily. Debugged code is gold.

Re:FAA lifted National Ground Stop at 0119Z by treesknees on Friday November 13, 2026 @10:54PM (#50493709)
We used to do this. Now every customer and their mother is demanding upgrades because their security contractor ran a scanner that flipped out over a version number string.
Re:FAA lifted National Ground Stop at 0119Z by winrid on Sunday November 15, 2026 @08:13AM (#50506711)
The longer you don't keep things like dependencies updated, the harder it is to update the second you have a security issue etc. you can end up absolutely screwed.
Re:FAA lifted National Ground Stop at 0119Z by LastTrain on Friday November 13, 2026 @09:40PM (#50493166)
Put someone competent & accountable in charge and then let’s talk.
Re:FAA lifted National Ground Stop at 0119Z by khimaros on Friday November 13, 2026 @10:07PM (#50493350)
how could this possibly not have been SMART? were they really doing two simultaneous rollouts?
Re:FAA lifted National Ground Stop at 0119Z by bamboozled on Friday November 13, 2026 @10:21PM (#50493452)
Sounds a bit like Chernobyl. People doing stupid stuff to keep “the party” happy.
Re:FAA lifted National Ground Stop at 0119Z by mitxela on Saturday November 14, 2026 @06:47AM (#50496244)
Chernobyl was get-there-itis which affects most systems. They pushed forward when they should have rolled back.
Re:FAA lifted National Ground Stop at 0119Z by Null-Set on Friday November 13, 2026 @10:29PM (#50493513)
They also kept noting that the new IP based routers were not showing any inconsistency. To me that says that they were bridging IP traffic over the legacy systems, probably a protocol with retransmits like TCP, and a storm of retransmits was overloading the legacy systems, and older components using a less durable protocol were drowned out and dropped packets.
Re:FAA lifted National Ground Stop at 0119Z by UltraSane on Friday November 13, 2026 @10:46PM (#50493636)
Mullin doesn't actually understand anything he said.
Re:FAA lifted National Ground Stop at 0119Z by Havoc on Saturday November 14, 2026 @07:57AM (#50496668)
aka more trump crowd yolo'ing sht way out of their depth
Re:FAA lifted National Ground Stop at 0119Z by HumblyTossed on Saturday November 14, 2026 @10:12AM (#50497661)
People have been saying since the 80s that patching/piecemeal doesn't work.
Re:FAA lifted National Ground Stop at 0119Z by saladdays on Friday November 13, 2026 @09:20PM (#50492988)
Don’t push updates to prod on Friday afternoon.
Re:FAA lifted National Ground Stop at 0119Z by souvlakee on Friday November 13, 2026 @09:21PM (#50492992)
What if grounded pilots killed time in Flight Simulator, which overloaded Azure?
Re:FAA lifted National Ground Stop at 0119Z by bvan on Friday November 13, 2026 @09:21PM (#50492996)
They found the missing floppy disk
Re:FAA lifted National Ground Stop at 0119Z by hdivider on Friday November 13, 2026 @09:24PM (#50493022)
Remembering this is the most corrupt administration in a long time, or ever.

So could it be they orchestrated this so they can get dozens of billions through this Congress in December before the Continuing Resolution expires, so they can funnel huge contracts to their preferred vendors?

Lutnick, Feinberg, all the others have been making moves like this -- as in, you award to the companies where you (or your family) have an investment.

The timing surely is not to be ignored. It just happens to be after a blue wave midterms and before the new Congress comes in? Pure coincidence? Coincidence does exist, but orchestration and patterns do too.

Re:FAA lifted National Ground Stop at 0119Z by jamesbfb on Friday November 13, 2026 @09:26PM (#50493035)
There is a lot of talk of legacy hardware. What hardware are they referring to? I love to nerd out and read up on this stuff.
Re:FAA lifted National Ground Stop at 0119Z by fortran77 on Friday November 13, 2026 @09:27PM (#50493050)
Re:FAA lifted National Ground Stop at 0119Z by BigBlackGorilla on Friday November 13, 2026 @09:27PM (#50493051)
The right emperor would get this antiquated shit fixed in a year. The entire country would be revolutionized overnight. Democracy and plebeian majority vote is pathetic, abysmal, bureaucratic bloat.
Re:FAA lifted National Ground Stop at 0119Z by lostlogin on Friday November 13, 2026 @09:29PM (#50493070)
The U.S. electoral system doesn’t necessarily reward the majority vote.
Re:FAA lifted National Ground Stop at 0119Z by Pxtl on Friday November 13, 2026 @09:30PM (#50493083)
That kind of thinking has gotten a lot of decent folks killed.
Re:FAA lifted National Ground Stop at 0119Z by cosmicgadget on Friday November 13, 2026 @09:41PM (#50493189)
This isn't normally a concern for people advocating for totalitarianism.
Re:FAA lifted National Ground Stop at 0119Z by BigBlackGorilla on Saturday November 14, 2026 @09:24AM (#50497249)
If you don't think you're living under totalitarianism at the moment you are a pathetic retard. Sleep Joe, Orange Man, 'now watch this drive Bush', all have been an illusion since JFK was assassinated by israel.
Re:FAA lifted National Ground Stop at 0119Z by BigBlackGorilla on Saturday November 14, 2026 @09:21AM (#50497232)
80,000,000+ children have been aborted under the guise of democracy, which is mob rule by man's lower nature
Re:FAA lifted National Ground Stop at 0119Z by Dumblydorr on Friday November 13, 2026 @09:35PM (#50493132)
You almost never get the right emperor. You probably get average emperors who make huge problems or bad emperors who could wreck the empire.
Re:FAA lifted National Ground Stop at 0119Z by BigBlackGorilla on Saturday November 14, 2026 @09:22AM (#50497237)
It's all falling apart anyway. I don't really care. I'm not on this planet for a long time.
Re:FAA lifted National Ground Stop at 0119Z by alfjal on Friday November 13, 2026 @09:28PM (#50493054)
They jumped from 3 airports to nationwide in one step, and are now framing it as the existing hardware not being compatible with their new software, rather than the other way around.
Re:FAA lifted National Ground Stop at 0119Z by lostlogin on Friday November 13, 2026 @09:31PM (#50493086)
If you count meatware as hardware, the failure more could be described as ‘antiquated hardware’.
Re:FAA lifted National Ground Stop at 0119Z by xnx on Friday November 13, 2026 @09:32PM (#50493104)
One time I plugged an Ethernet cable in the wrong port and created a loopback. That's my guess.
Re:FAA lifted National Ground Stop at 0119Z by derwiki on Saturday November 14, 2026 @12:02AM (#50494128)
That happened at my job in 2010. Val, we know it was you!
Re:FAA lifted National Ground Stop at 0119Z by 0x4e on Friday November 13, 2026 @09:42PM (#50493196)
Right when I left the airport.

BTW, Uber surge pricing felt absurd in this situation.

Re:FAA lifted National Ground Stop at 0119Z by anon84873628 on Friday November 13, 2026 @09:59PM (#50493295)
FWIW Uber did waive cancellation fees on reservations to/from an airport.
Re:FAA lifted National Ground Stop at 0119Z by VladVladikoff on Friday November 13, 2026 @10:20PM (#50493446)
I wonder if the drivers actually get an advantage in this situation or if it’s just uber milking things.
Re:FAA lifted National Ground Stop at 0119Z by dearing on Friday November 13, 2026 @09:43PM (#50493201)
I just happened to have vibecoded an ATS myself, pats.ai.

Unrelated I only fly ocunus because I don't want a blue haired pilot.

Re:FAA lifted National Ground Stop at 0119Z by jschrf on Friday November 13, 2026 @09:48PM (#50493228)
Pet theory: the fancy new solution used an LLM and they realized it couldn't handle production workflow so they had to rollback hard.
Re:FAA lifted National Ground Stop at 0119Z by morkalork on Friday November 13, 2026 @09:54PM (#50493260)
>That's a nice airspace you have there, shame if something were to happen to it. Now sign this $50B check for our buddies and it'll all be ok
Re:FAA lifted National Ground Stop at 0119Z by interestica on Friday November 13, 2026 @10:06PM (#50493349)
Clearly they asked their new AI tool to "make air travel safer" and it found a zero-day to ground all flights.
Re:FAA lifted National Ground Stop at 0119Z by jaypatelani on Friday November 13, 2026 @10:08PM (#50493367)
As friend from Mastodon has suggested: "So this would be a great night to play atc(6) from the BSD Games collection on NetBSD"

https://tilde.zone/@sirwumpus/117611840050306362

Re:FAA lifted National Ground Stop at 0119Z by starkparker on Friday November 13, 2026 @10:11PM (#50493385)
Since the threads keep getting closed about Hawaii DoT confusing everyone by claiming SpaceX debris was contributing to their shutdown despite the Starship launch being in Texas, successfully reaching orbit, and having a booster land in the Atlantic:

Hawaii was the early/late splashdown site and pre-cleared: https://www.cbsnews.com/news/spacex-launches-starship-flight...

SpaceX released the early return around 4 p.m. Pacific: https://x.com/TrackingTheSB/status/2121392533418786992

HDOT phrased it badly, but there was a window today where Starship could have aborted over the west coast in the middle of this shutdown.

Re:FAA lifted National Ground Stop at 0119Z by MarsZebra on Friday November 13, 2026 @10:27PM (#50493499)
um.. you meant booster EXPLODED in the Gulf of AMERICA? Land my aSS.
Re:FAA lifted National Ground Stop at 0119Z by darknavi on Friday November 13, 2026 @10:37PM (#50493567)
Looked like it was a soft touchdown until engines shut off at the "catch" height (simulated) and then they activated the TFS.
Re:FAA lifted National Ground Stop at 0119Z by soared on Friday November 13, 2026 @10:47PM (#50493647)
“Exploded at a specific time”
Re:FAA lifted National Ground Stop at 0119Z by brandonagr2 on Friday November 13, 2026 @10:46PM (#50493632)
Exploded safely as planned during an off shore divert from the tower catch attempt, after making a controlled hover in mid air slightly above the water.
Re:FAA lifted National Ground Stop at 0119Z by MarsZebra on Friday November 13, 2026 @11:35PM (#50493982)
And also spewing green flame from the disintegrating copper of the engine
Re:FAA lifted National Ground Stop at 0119Z by carterschonwald on Friday November 13, 2026 @10:12PM (#50493393)
is the root cause some no bid contract ?
Re:FAA lifted National Ground Stop at 0119Z by totetsu on Friday November 13, 2026 @10:13PM (#50493397)
>DESTINATION AIRPORT:ALL FACILITIES INCLUDED: ALL EXPECT UPDATE:0400Z REASON: REMARKS: THE FAA COMMAND CENTER NATIONWIDE GROUND STOP HAS BEEN CANCELLED.

between opening the page and reloading it got cancelled?

Re:FAA lifted National Ground Stop at 0119Z by interestica on Friday November 13, 2026 @10:15PM (#50493408)
Press conference https://www.youtube.com/live/M1WhY3qcJjE?si=KUFvgHO-EepCi1v6

Notably, the problem was described as "routers overloaded with data". When directly questioned if this could be a cyber attack or rogue ai agent the Sec/Homeland responded "there's nothing completely certain now."

Re:FAA lifted National Ground Stop at 0119Z by operatingthetan on Friday November 13, 2026 @10:18PM (#50493424)
The way they are being so evasive makes me think they did a pretty big screw up.
Re:FAA lifted National Ground Stop at 0119Z by kQq9oHeAz6wLLS on Friday November 13, 2026 @10:42PM (#50493604)
Or a non-technical person is relating the information as they understand it to a non-technical press corps, so everything is generic and hand-wavy. Honestly, have you never dealt with non-technical C-suite staff?
Re:FAA lifted National Ground Stop at 0119Z by operatingthetan on Saturday November 14, 2026 @03:23PM (#50500442)
>Honestly, have you never dealt with non-technical C-suite staff?

Weird tone.

Re:FAA lifted National Ground Stop at 0119Z by Alexsky2 on Friday November 13, 2026 @10:21PM (#50493456)
For those interested, there was a 2009 outage of the FAA Telecommunications Infrastructure that at a surface level seems like it could be a similar failure mode. At the very least, it is an interesting read on how the FAAs systems operate, since a lot of the discussion so far has been wild speculation from people with little knowledge on how the national airspace system actually operates: https://www.oig.dot.gov/library-item/29670

Of particular note is this section: Risks of FTI Outages for Existing Operational Services As of December 2009, Harris reported that there are a total of 20,982 services operating on the FTI network. While FAA has transitioned all 1,808 IP services supporting FAA flight plans to the new FTI fiber optic network, additional risks will be introduced when the Agency begins transitioning other FAA services, such as En Route Automation Modernization (ERAM) and NextGen platforms, which also require IP technology to operate. Moreover, there are 19,174 existing services that may be transitioned to the new FTI fiber optic network. According to FAA, transitioning these remaining services is important because FTI now connects older FAA systems that provide safety-critical voice and surveillance radar information by utilizing Time Division Multiplex (TDM) technology, instead of IP services.

Re:FAA lifted National Ground Stop at 0119Z by sneak on Friday November 13, 2026 @10:28PM (#50493510)
TBH TDM is far superior and it’s sad that the world discarded it. Packet switching is the worst thing to ever happen to phone calls. Kids today have no idea how good it used to be (albeit at $0.50/min).
Re:FAA lifted National Ground Stop at 0119Z by locusofself on Friday November 13, 2026 @10:38PM (#50493576)
I mean the fidelity of modern mics/converters/codecs in devices now is much better, but ya the tradeoff of VoIP is latency/jitter/dropouts etc
Re:FAA lifted National Ground Stop at 0119Z by doctorshady on Friday November 13, 2026 @11:03PM (#50493784)
TDM only implies (in the traditional 8-bit framing format, at least) that you're giving a 64 kbps timeslot to a caller. You can put any arbitrary payload in there, like AAC, Opus, or whatever. Preferably a codec without an intrinsic lookahead delay though. You can bond multiple 64k timeslots too.

Glad someone else appreciates circuit switched technologies though :) . It really does shine in any application that isn't burst-y data transfers.

Re:FAA lifted National Ground Stop at 0119Z by adgjlsfhk1 on Friday November 13, 2026 @11:46PM (#50494031)
has there been work on good real time audio codecs? I wonder how good you can do if you limit yourself to a latency of <1 sample?
Re:FAA lifted National Ground Stop at 0119Z by hdgvhicv on Saturday November 14, 2026 @04:33AM (#50495507)
Professional audio works in profiles down to 125us packets, so at 48khz that’s 6 samples per packet. For IP/Ethernet that means 18 byte payload translating to 76 byte Ethernet after the various headers, and another 20 bytes of preamble. That’s 800ns at 1gbit.

if you’re using IPv6 (nobody does) that increases another 20 bytes.

You’d typically have a receive buffer in the 1ms range though , although in theory you’d get away with 500us or even 375us on paper.

I believe (not really my area, in video we deal with timings starting in the tens in the tens of microseconds, and quantisation in the milliseconds) the rule of thumb is the total system latency between microphone and speaker have to be all within 5ms to avoid problems

Re:FAA lifted National Ground Stop at 0119Z by jpc0 on Saturday November 14, 2026 @06:03AM (#50496007)
Exactly this but it is still running on the age old RTP stack with raw PCM packets.

Using FPGAs you can get to very low latency.

Also at some point the latency is a non-issue.

Speed of light even in fiber optics is significantly faster than the speed put sound.

And compared to TDM which is the comparison here the only thing added in packet networks latency wise is buffers, for network switches that can be nearly instant so it is only on the send and receive side.

So pretty much if you want to drop dark fiber between endpoints you can get the exact same benefits of TDM on packet switched networks without the disadvantages.

The people asking for TDM are ignoring the fact the literally several industries and some that care greatly about audio quality and latency have prettier much determined that packet switched networks are fine.

Re:FAA lifted National Ground Stop at 0119Z by kevin_nisbet on Saturday November 14, 2026 @02:09AM (#50494761)
> Glad someone else appreciates circuit switched technologies though :) I worked on VoLTE, the amount of twisting we had to do to make the packet network work kinda-sorta like the circuit network was interesting. Overall I think it was a win to make voice another service, but it was a huge investment.
Re:FAA lifted National Ground Stop at 0119Z by xnx on Friday November 13, 2026 @11:05PM (#50493793)
It was painful not having full duplex calls for so long.
Re:FAA lifted National Ground Stop at 0119Z by meonkeys on Saturday November 14, 2026 @10:49AM (#50497963)
This! Full duplex felt so much more like a warm, live conversation. Talking in person can overlap a lot, in a Good way.
Re:FAA lifted National Ground Stop at 0119Z by FabHK on Saturday November 14, 2026 @12:50AM (#50494391)
Fact: With the good old phone (POTS), when it rang you picked up and said "hello" and started talking. It just worked.

Now, on many calls, the first few seconds are spent on "Do you hear me? Hello? Yes I hear you.". (At work, we call it the Microsoft Teams Random Number Generator - every call gives you one bit with around 50/50 chance (aka one bit)).

Re:FAA lifted National Ground Stop at 0119Z by hylaride on Saturday November 14, 2026 @10:03AM (#50497581)
To be fair, that usually has nothing to do with the network and 99% to do with operating system permissions and mute, microphone, or bluetooth issues.
Re:FAA lifted National Ground Stop at 0119Z by jjtheblunt on Friday November 13, 2026 @11:07PM (#50493800)
wait what? show me the data.

by far the clearest phone calls i've ever been on which were not landline were 2001 era Sprint CDMA, probably because the vocoder bitrate was higher than in later configurations (like LTE), or the MOS scores were held to a higher standard then.

Re:FAA lifted National Ground Stop at 0119Z by novok on Saturday November 14, 2026 @12:39AM (#50494340)
It's really enshittification / phone quality shrinkflation because most normies are not able to articulate what the differences are. Proper QoS, prioritization and bit rate at full duplex would've still worked.
Re:FAA lifted National Ground Stop at 0119Z by bdamm on Saturday November 14, 2026 @01:23AM (#50494545)
Sprint's "pin drop" ads were bold.

Phones of old could be high quality, and they were always extremely low latency. But usually they were scratchy or muffled or noisy or otherwise compressed. A Teams call on a low-latency low-loss line with good microphones on each side is a far better experience than any long distance call from the 90's. It's just that normally the data connection is not so good.

Re:FAA lifted National Ground Stop at 0119Z by epcoa on Saturday November 14, 2026 @04:07AM (#50495366)
Calls within and across major networks in the US are crystal clear HD voice (16 kHz sampling) with a decent codec. CDMA of yore was never that good.
Re:FAA lifted National Ground Stop at 0119Z by trollbridge on Saturday November 14, 2026 @10:49AM (#50497970)
Latency used to be a lot better though.
Re:FAA lifted National Ground Stop at 0119Z by Animats on Friday November 13, 2026 @11:08PM (#50493802)
How do you "overload" a TDM system? It's just a multiplexer that turns one wideband link into N lower bandwidth links by bitwise interleaving. You can't "overload" it. Whatever assigns links might be overloaded, and that's usually something like a telephone switch.

There's an unverified mention of a fiber cut, which might result in fewer circuits being available. That usually returns an "all circuits busy" signal.

None of the explanations will make sense until they stop coming from unqualified political appointees.

Re:FAA lifted National Ground Stop at 0119Z by dboreham on Friday November 13, 2026 @11:27PM (#50493931)
It's probably not TDM end to end nowadays. If they're backhauling it via MPLS or similar then loss of fiber capacity might render the legacy link inoperable.
Re:FAA lifted National Ground Stop at 0119Z by stackghost on Saturday November 14, 2026 @12:38AM (#50494334)
>How do you "overload" a TDM system? It's just a multiplexer that turns one wideband link into N lower bandwidth links by bitwise interleaving. You can't "overload" it.

A TDM system can't have infinite throughput, can it? Either you operate with fixed slot windows, as legacy systems usually do, in which case excess data has to wait and buffers fill up, or else you operate with variable time slots, and at some point the windows get too narrow to transmit usable information.

It doesn't make sense to me to claim you "cannot overload" a TDM system. Bandwidth is finite.

Re:FAA lifted National Ground Stop at 0119Z by axus on Saturday November 14, 2026 @12:45AM (#50494368)
Maybe busy signals that prevent new calls from connecting instead of packet loss / disconnections. Kids these days have never heard a busy signal.
Re:FAA lifted National Ground Stop at 0119Z by vel0city on Saturday November 14, 2026 @11:48AM (#50498456)
If clients are failing to connect because the link has no more capacity, isn't that an "overloaded" failure mode?
Re:FAA lifted National Ground Stop at 0119Z by stackghost on Saturday November 14, 2026 @03:25PM (#50500467)
> Kids these days have never heard a busy signal.

Busy signals are literally a capacity limit being hit.

Re:FAA lifted National Ground Stop at 0119Z by crackez on Saturday November 14, 2026 @05:11PM (#50501502)
I'm most cases, a capacity of one... Eg. the callee (destination) is already on an active call.
Re:FAA lifted National Ground Stop at 0119Z by red75prime on Saturday November 14, 2026 @01:16AM (#50494516)
> Kids today have no idea how good it used to be

Ah, the glorious 3kHz frequency range of old.

Re:FAA lifted National Ground Stop at 0119Z by sneak on Saturday November 14, 2026 @10:07AM (#50497615)
…that never had 100-5000ms audio dropouts once a call was connected. I’d take that any day over the public IP network.
Re:FAA lifted National Ground Stop at 0119Z by wyager on Saturday November 14, 2026 @01:25AM (#50494561)
You can still pay for dedicated TDM internet slots if you're a corporate customer on a shared PON or something. Unfortunately there's not much consumer demand for figuring out how to make this work smoothly for consumer telephony via QoS tiers or something.
Re:FAA lifted National Ground Stop at 0119Z by mirmor23 on Saturday November 14, 2026 @01:53AM (#50494681)
> TBH TDM is far superior and it’s sad that the world discarded it. Packet switching is the worst thing to ever happen to phone calls.

Your feelings here have no technical basis. TDM is pre-provisioned, bandwith-reserved, latency-capped network that was probably hard for packet switched network 25 years ago. But with all that has gone in -- switched ethernet, qos, oam -- there is absolutely no reason to go back. Heck, even whatsapp calls across 12-hour time zones are quite crisp and free.

Re:FAA lifted National Ground Stop at 0119Z by ucyo on Saturday November 14, 2026 @02:27AM (#50494850)
Because you mentioned WhatsApp. There is an interesting podcast about the Western Electric 500 phones and the architecture of actual phone lines. There is a section where they compare it to WhatsApp and time delay. Maybe of interest…

https://pca.st/episode/a12e4bb6-4e1f-4b57-8f1c-b627b4275869

Re:FAA lifted National Ground Stop at 0119Z by Karrot_Kream on Saturday November 14, 2026 @03:18AM (#50495136)
Ooh cool podcast link, thanks for the rec. Surprised I didn't catch a 99% Invisible podcast on one of my favorite topics.

Good to remember that a WhatsApp call is being routed over a much more diverse, heterogeneous set of networks than a Western Electric 500 phone was. 32-bit stereo raw audio is roughly 2.82 Mbps, which is a lot better than what an older phone did. On any link between two endpoints with 20 Mbps or more symmetric, you can do this trivially. WhatsApp can give you good performance between two crowded venues on completely different parts of the world. Just a very different experience.

Re:FAA lifted National Ground Stop at 0119Z by throw0101d on Saturday November 14, 2026 @07:44AM (#50496591)
Re:FAA lifted National Ground Stop at 0119Z by mirmor23 on Saturday November 14, 2026 @10:20AM (#50497730)
> There is an interesting podcast about the Western Electric 500 phones and the architecture of actual phone lines.

Thank you! learnt about Henry Dreyfuss. It's sad the way he died, but can understand.

https://en.wikipedia.org/wiki/Henry_Dreyfuss

Re:FAA lifted National Ground Stop at 0119Z by stingraycharles on Saturday November 14, 2026 @03:28AM (#50495187)
Yeah as someone who has video calls across the globe every day, it’s absolutely fine as long as your internet provider doesn’t cheap out on provisioning / uplinks. But in the end that’s a “you get what you pay for” issue.
Re:FAA lifted National Ground Stop at 0119Z by eecc on Saturday November 14, 2026 @03:57AM (#50495318)
Codecs are exceptionally good at adapting to available bandwidth and latency.

What kills realtime is buffer bloat

Re:FAA lifted National Ground Stop at 0119Z by vlan0 on Saturday November 14, 2026 @07:08AM (#50496382)
Right, hence their comment about uplinks. They cheap out, that saturates, then we buffer
Re:FAA lifted National Ground Stop at 0119Z by stingraycharles on Saturday November 14, 2026 @07:53AM (#50496638)
bufferbloat is actually more than that; it’s actually that the buffers are oversized, which is typically not what you want. This causes a lot of jitter and increases latency.

basically, for realtime stuff, you want to prefer packets being dropped rather than buffered.

this is an excellent resource on the subject: https://www.bufferbloat.net/projects/bloat/wiki/Introduction...

Re:FAA lifted National Ground Stop at 0119Z by jacquesm on Saturday November 14, 2026 @12:57PM (#50499175)
And it makes echo cancellation terrible.
Re:FAA lifted National Ground Stop at 0119Z by crackez on Saturday November 14, 2026 @05:07PM (#50501473)
That's why auto_qos was invented...
Re:FAA lifted National Ground Stop at 0119Z by jd3 on Saturday November 14, 2026 @09:42AM (#50497395)
zero latency and no jitter
Re:FAA lifted National Ground Stop at 0119Z by mirmor23 on Saturday November 14, 2026 @10:14AM (#50497674)
> zero latency and no jitter

this would beat the laws of physics. realistically, it is more like "fixed latency, and very little jitter".

Re:FAA lifted National Ground Stop at 0119Z by cryptonector on Saturday November 14, 2026 @04:05PM (#50500806)
Zero _extra_ latency. It's like 'no sugar added' but the food is sweet anyway, just less sweet than if sugar had been added.
Re:FAA lifted National Ground Stop at 0119Z by e12e on Saturday November 14, 2026 @11:39AM (#50498375)
> Heck, even whatsapp calls across 12-hour time zones are quite crisp and it is free

I don't think anyone seriously think that 5g and VoIP voice quality is bad - but latency is absolutely a problem, especially in group calls.

Re:FAA lifted National Ground Stop at 0119Z by willis936 on Saturday November 14, 2026 @12:39PM (#50498982)
I mean, there is technical basis. This is a classic latency vs. throughput tradeoff. Obviously reserving most the channel for quiet lines is not good for throughput, but it does work wonders for worst case latency. Bandwidth reservation is not without merit.
Re:FAA lifted National Ground Stop at 0119Z by Karrot_Kream on Saturday November 14, 2026 @03:03AM (#50495039)
Definitely think circuit switching has merit for real time comms even today, but that's a separate discussion. Over physically private links, whether you're using MPLS or TDM shouldn't matter.
Re:FAA lifted National Ground Stop at 0119Z by hdgvhicv on Saturday November 14, 2026 @04:20AM (#50495435)
MPLS typically wouldn’t be physically private, no more than any other IP network, just a different forwarding technology. You can run MPLs over ip networks and ip networks over MPLs.

I have everything from dedicated inter building fibre cables, through cores, wavelengths, ethernet services, IP circuits (still have one international MPLS and a VPLS network eoth 4 exit nodes), to normal internet with varying levels of contention.

Even the fibres aren’t private - they are patched through other people’s equipment rooms, even on short runs if a few miles, and even on the circuits that don’t, they run through ducts over other people’s land.

Packet switching has variable latency. This can be controlled with ptp and qos, and in reality we’re talking sub microsecond differences if you need it, switch latency is measured in nanoseconds And that’s way below the timing ministry is worried about (which is in the tens of microsecond level). TDM will give you guarenteed latency though, you get a slot every X time units regardless, jitter isn’t 2us, it’s zero.

I don’t believe any application needs sub microsecond jitter, but there may well be some scientific applications that do, but at that level you’re running on dedicated cores or maybe wavelengths, between specific equipment.

Re:FAA lifted National Ground Stop at 0119Z by Karrot_Kream on Saturday November 14, 2026 @05:11AM (#50495708)
What stack do you think the FAA is using? I would expect they have private links but maybe I'm wrong.
Re:FAA lifted National Ground Stop at 0119Z by hdgvhicv on Saturday November 14, 2026 @06:50AM (#50496266)
They don’t own the land the fibres run on, I suspect that many will be patched through exchanges and data centres they don’t own.

It won’t surprise me ifs y places are services provided by other companies - either ip or ethernet, to connect to larger sites. I suspect some will even be connected via public networks.

Major sites may have dedicated fibres between them but whether that’s just a wavelength on someone else’s core, or even a dark fibre but just one core on someone else’s cable, is anyone’s guess. I’d be surprised if they could justify the cost of a highly resilient network dedicated to themselves rather than renting capacity.

What I’m certain is they don’t own their own fibres to every end point.

Re:FAA lifted National Ground Stop at 0119Z by Karrot_Kream on Saturday November 14, 2026 @09:44PM (#50503482)
Thanks for the context. I've never touched the physical end of this industry, so this is good info.
Re:FAA lifted National Ground Stop at 0119Z by hylaride on Saturday November 14, 2026 @10:00AM (#50497555)
The FAA is using a mish-mash of tech, because it's been layered on over the years and is constantly starved of funds and investment because it's a government agency that needs congress to sign off on changes. Some network links are modern fibre optic lines, while others are still over decades old copper. Canada's ATC provider, NAV Canada, is not a direct government agency but a regulated nonprofit funded by fees - so it has the ability to modernize as it makes sense. The US still largely uses Radar and voice instead of satellites and data links that Canada moved to decades ago! The story is similar in other western jurisdictions that have modernized long ago.

Some US airports (~90) are still using paper flight strips while other jurisdictions long ago moved on: https://enotrans.org/article/electronic-flight-strips-brief-...

Re:FAA lifted National Ground Stop at 0119Z by Karrot_Kream on Saturday November 14, 2026 @09:45PM (#50503491)
Yeah I'm aware of some of this through the woes of ATC modernization. Sadly I didn't know anything about how NAV Canada was a nonprofit funded by user fees. I know a lot of folks in the US oppose privatization of ATC, but this is an interesting example. Thanks!
Re:FAA lifted National Ground Stop at 0119Z by adrian_b on Saturday November 14, 2026 @12:41PM (#50499002)
The difference between TDM and packet switching is the same as between static memory allocation and dynamically allocating heap memory.

If you can afford to allocate statically the space for all the variables that your program will ever use, you will certainly increase a lot both the performance and the reliability of your program.

Alas, for many tasks this would result in a requirement for more memory than you can afford, especially today.

To use more efficiently the limited amount of memory that you have, you need to use dynamic memory allocation.

The same happens with your communication infrastructure. Using it with packet switching reduces the reliability and the performance of individual communications, but it uses the capacity much more efficiently, i.e. the aggregated throughput of all communications passing through a given infrastructure is greatly increased.

Re:FAA lifted National Ground Stop at 0119Z by boznz on Saturday November 14, 2026 @12:43PM (#50499029)
[delayed]
Re:FAA lifted National Ground Stop at 0119Z by miki123211 on Saturday November 14, 2026 @01:26PM (#50499430)
I think the superiority of TDM is diminished if there's a wireless link somewhere in the mix (and there very often is for modern consumer tech).

TDM was more stable because nobody was hopping on meetings while walking their dog on a noisy street and then taking the elevator back home. The expectations have shifted.

Modern consumer links (even over WiFi) are usually adequate enough to do reliable, high-quality voice calls over the public internet. We basically choose not to; most VOIP apps are optimized to work decently in a noisy car driving through a forest when on speakerphone, instead of working very well in a quiet room on headphones and crapping out everywhere else. This is a choice we make; there are apps out there that make different choices. Once upon a time, I was very unhappy with that choice, then I grew up and have experienced what the consequences of making different choices really are.

With that said, classical Bluetooth audio urgently needs to die. There's no reason for it to be as bad as it is, and it is truly abhorrent. Better protocol design is definitely possible; most wireless (2.4GHz, gaming) headphones have much better quality and much lower latency. BLE audio will fix most of Bluetooth's warts, and it is slowly, so very slowly appearing on the market.

Re:FAA lifted National Ground Stop at 0119Z by fffrantz on Saturday November 14, 2026 @07:38PM (#50502685)
ISDN calls are of such good quality and so stable that public radios used ISDN links for their reporters in other countries. It still was the norm 15/20 years ago, and now you get awful quality every time someone’s joining a broadcast through Zoom/Teams/etc.
Re:FAA lifted National Ground Stop at 0119Z by LastTrain on Friday November 13, 2026 @11:57PM (#50494096)
“See this admin is just like all the others” sorry, no.
Re:FAA lifted National Ground Stop at 0119Z by medellin on Saturday November 14, 2026 @03:00AM (#50495023)
Wild speculation… little knowledge… on HN?? No way!!!
Re:FAA lifted National Ground Stop at 0119Z by mat_epice on Friday November 13, 2026 @10:40PM (#50493597)
I took the opportunity to ask Fable what the 50% over/under on my 7am flight being delayed tomorrow, and it used 33% of my four hour window to come up with an answer of 15 minutes. Somehow, I doubt it.
Re:FAA lifted National Ground Stop at 0119Z by dang on Friday November 13, 2026 @10:54PM (#50493701)
Re:FAA lifted National Ground Stop at 0119Z by Rover222 on Friday November 13, 2026 @11:01PM (#50493758)
The decrepit nature of the flight control system is just a good example of big government management of any large system is usually bound by inertia, self-interest, and lack of motivation to be ambitious and cutting edge.

There are/were of course brief spikes in govt-controlled entities acting with extreme motivation (1950's NASA, the Manhattan project, etc), but that's usually driven by a perceived dire national threat.