News for hackers. Stuff that matters.
Re:Full Shutdown of L Train to Be Halted by Cuomo by hinkley on Thursday January 03, 2019 @01:58PM (#18818020)
It sounds like some software war room meetings. Everything is oversubscribed and if you have to take one thing down for maintenance (even a redundant thing) turns into the apocalypse.

One system starts emitting 50% more traffic and everything else falls over because everything is running at 80% of capacity all the time.

We're trying to combine our multi-region and failover efforts and I just know it'll take about a week for us to have all data centers running at more than 1/n of capacity. And then instead of having no war room when one data center goes offline we'll have one when anything hiccups.

Re:Full Shutdown of L Train to Be Halted by Cuomo by aaronblohowiak on Thursday January 03, 2019 @04:23PM (#18819427)
You should have 1/(n-1) capacity in each region to support any region going down, if n is number of regions. https://youtu.be/q1klRdPh-V8 Or hit me up if you wanna chant more about this stuff - it is a passion of mine. (And we’re hiring...)