News for hackers. Stuff that matters.
Re:Level 3 Global Outage by jacquesm on Sunday August 30, 2020 @06:32PM (#24326521)
> Normal testing was bypassed - per management request after a small code change.

That lesson will really never be learned. This happens on a daily basis all over the planet with people who have not been bitten - yet.

Re:Level 3 Global Outage by cortesoft on Sunday August 30, 2020 @07:18PM (#24326856)
It isn't learned because 99% of the time, it works fine and nothing bad happens.

We are very bad at avoiding these sorts of rare, catastrophic events.

Re:Level 3 Global Outage by eru on Sunday August 30, 2020 @10:13PM (#24327900)
That's why the most reliable way to instil this lesson is to instil it into our tools. Automate as much testing as possible, so that bypassing the tests becomes more work than running them.
Re:Level 3 Global Outage by smaudet on Monday August 31, 2020 @07:46AM (#24330435)
I disagree, it's in part a people problem - more draconian test suites just make developers more inclined to cheat and they tend to write tests which are not valid or just get the tool passing...

It's more important to visually model and test than to enforce some arbitrary set of rules that don't apply universally - then you have at least the visual impetus of 'this is wrong' or 'I need to test this right'.

A lot of time is spent visually testing UIs and yet these same people struggle with testing the code that matters...

Re:Level 3 Global Outage by monkpit on Monday August 31, 2020 @11:05AM (#24332183)
Until a manager is told about how hard the automation makes it to accomplish their goal...
Re:Level 3 Global Outage by eru on Tuesday September 01, 2020 @02:14AM (#24339024)
You need buy-in to automation at a high enough level.

If a team manager at eg Google was complaining about how automation gets in the way and wanted to bypass it, they wouldn't last too long.

Re:Level 3 Global Outage by edoceo on Sunday August 30, 2020 @06:53PM (#24326687)
Managers who have been bitten still make this choice
Re:Level 3 Global Outage by coryrc on Sunday August 30, 2020 @07:41PM (#24326982)
Or most of what we do isn't really important so it doesn't matter if it breaks every once in a while.