Automation emboldens policy makers to reduce human count because of the perceived increase in safety. This results in less eyes and brains monitoring for situations of automation failure or abnormalities. The corner stone of aviation safety over the last several decades has been having multiple, highly trained and experienced operators on station monitoring aviation systems to catch those moments when something goes wrong. Additionally, a culture where those operators are encouraged to speak up and be heard when something goes wrong without fear of being reprimanded is essential.

Automation is fantastic. We use it extensively in aviation. However, the long tail of 9s in reliable requires constant vigilance and oversight because anything that can go wrong will.