News for hackers. Stuff that matters.

A comment on Post-Mortem for Google Compute Engine’s Global Outage on April 11.

Re:Post-Mortem for Google Compute Engine’s Global Outage on ... by hsod on Wednesday April 13, 2016 @01:58PM (#11490565)
> Crucially however, a second software bug in the management software did not propagate the canary step’s conclusion back to the push process, and thus the push system concluded that the new configuration was valid and began its progressive rollout.

Perhaps the progressive rollout should wait for an affirmative conclusion instead of assuming no news is good news? I'm not being snarky, there may be some reason they don't do this.

[ Parent | on HN ]
Re:Post-Mortem for Google Compute Engine’s Global Outage on ... by windwake12 on Wednesday April 13, 2016 @02:34PM (#11490944)
Presumably it received a false positive (or it was interpreted as such). This really seems like the root cause, and I suspect a case of happy path engineering striking again.
[ Parent | on HN ]