News for hackers. Stuff that matters.
Re:FAA says computer failure was caused by 2 contractors who... by malux85 on Saturday January 14, 2023 @11:59AM (#34381750)
Did you read the article?

It explains that procedures were circumvented and something in production was edited - something that was not allowed.

You can put as many procedures in place as you want, but unless the humans follow these procedures (I.e. not circumvent them deliberately) then someone always has some level of access where they can cause mayhem.

Sure you can programmatically enforce this to a large extent, but ultimately there are always some humans with prod access, or BGP editing access, or firewall write access, or access to that validation logic itself! And it requires that the humans follow the organisational procedures in place.

From what the article says, it sounds like the humans deliberately circumvented procedures, in which case, it is the engineers fault, and they should be disciplined.

Re:FAA says computer failure was caused by 2 contractors who... by karmakaze on Saturday January 14, 2023 @12:11PM (#34381857)
There's no mention of deliberate circumvention. It doesn't even say there was circumvention, only that the files were damaged with the rules in place. If the rule is "don't damage these files when writing them" and it's your job to write them, it's adds no safety.

> Like other computer systems that are critical to operating flights, the FAA has imposed procedures to ensure data aren’t damaged by technicians working on them, said the person. The file or files were altered in spite of rules that prohibit those kind of changes on a live system.

> Agency officials are attempting to determine whether the two people made the changes accidentally or intentionally, and if there was any malicious intent, the person said.

Re:FAA says computer failure was caused by 2 contractors who... by ajross on Saturday January 14, 2023 @12:58PM (#34382265)
The lede reads, verbatim: "The computer failure that prompted a halt of all US flight departures was caused when a data file was damaged as a result of a failure to follow government procedures, the Federal Aviation Administration said Thursday."

It is clearly implied that had the rules been followed, the corruption wouldn't have occurred.

Your blame-the-FAA scenario where the rules were incomplete or flawed isn't ruled out, but I don't see value in asserting it without evidence. I think it's perfectly plausible that someone just cheated a bit. That's hardly a rare situation in any IT environment, and so it seems like Occam favors the article's interpretation.

Re:FAA says computer failure was caused by 2 contractors who... by peteradio on Saturday January 14, 2023 @01:28PM (#34382598)
Government defined rules, were they ever implemented in the org?
Re:FAA says computer failure was caused by 2 contractors who... by CoastalCoder on Saturday January 14, 2023 @12:07PM (#34381819)
Sometimes employees are pressured / instructed / trained to deviate from written instructions.

It can be justified as "the instructions are out of date", "this is an urgent change", "just get it done!", etc.

Heck, sometimes following the written rules is derided as "working to rule" or "takes longer than others to complete the task".

I'm just saying that blame for these issues only sometimes belongs on the line workers.

Re:FAA says computer failure was caused by 2 contractors who... by carlmr on Saturday January 14, 2023 @01:26PM (#34382579)
Another one: sometimes, especially in large organizations, there are so many rules that you can't find anyone who actually knows them. Making it unlikely they're being followed.

In large org thinking, if something bad happens, and you add a rule, then it's fixed.

The problem is that this is not compatible with human psychology.

This leads to many rules, the rules are unstructured and impossible to learn, the rules probably also contradict each other.

In my experience, a rule without automatic enforcement should be the absolute last thing to depend on. If you do this, your org is broken.

The Toyota Production System with it's blame on process design instead of humans is still the best way to avoid these issues IMO.

Do 5-whys where human error is not allowed as a root cause. Design your process with poka yoke in mind. If somebody can forget something they will. Don't depend on it.

Re:FAA says computer failure was caused by 2 contractors who... by guitarbill on Saturday January 14, 2023 @12:11PM (#34381846)
We don't know the "procedures". They could be braindead, overly complex, and/or impossible to follow.
Re:FAA says computer failure was caused by 2 contractors who... by landemva on Saturday January 14, 2023 @03:48PM (#34384033)
Procedures can be read by filing a FOIA request. I may be interested in reading it.