News for hackers. Stuff that matters.
Re:Ask HN: YouTube down? by trevyn on Tuesday October 16, 2018 @10:02PM (#18235341)
My vote: Bad configuration got pushed.
Re:Ask HN: YouTube down? by SteveNuts on Tuesday October 16, 2018 @10:17PM (#18235477)
I thought they had all sorts of crazy canary deployment processes that will automatically stop/rollback the deployment if the failure metrics start increasing?
Re:Ask HN: YouTube down? by p0rkbelly on Tuesday October 16, 2018 @10:29PM (#18235596)
There was a GCP Global network outage maybe a year or two ago, where their canary of a canary (Yo dawg, I heard you like bugs, so I I put a but inside of your bug) caused a cascading network failure.

It was a bad config push -- brownouts fighting with brown outs. Consistency issues. I bet this is happening.

Re:Ask HN: YouTube down? by corodra on Tuesday October 16, 2018 @10:21PM (#18235513)
Ran out of canaries?

Well, could be an unforeseeable-wack-crazy-bug. Can't plan for every possible failure.

Re:Ask HN: YouTube down? by SteveNuts on Tuesday October 16, 2018 @10:23PM (#18235549)
That's very true, there's always a bug somewhere lurking, even if you're Google.