News for hackers. Stuff that matters.

A comment on Google Kubernetes Engine's third consecutive day of service disruption. Parent comment

Re:Google Kubernetes Engine's third consecutive day of servi... by toomuchtodo on Sunday November 11, 2018 @06:00PM (#18429274)
That shouldn't, but they do. S3 goes down [1]. The AWS global console goes down, right after Prime Day outages [2]. Lots of Google Cloud services go down [3, current thread]. Tens of Azure services go down hard [4].

Are software development and release processes improving to mitigate these outages? We don't know. You have to trust the marketing. Will regions ever be fully isolated? We don't know. Will AWS IAM and console ever not be global services? We don't know.

Blah blah blah "We'll do better in the future". Right. Sure. Some service credits will get handed out and everyone will forget until the next outage.

Disclaimer: Not a software engineer, but have worked in ops most of my career. You will have downtime, I assure you. It is unavoidable, even at global scale. You will never abstract and silo everything per region.

[1] https://www.theregister.co.uk/2017/03/01/aws_s3_outage/

[2] https://www.cnbc.com/2018/07/16/aws-hits-snag-after-amazon-p...

[3] https://www.cnet.com/news/google-cloud-issues-causes-outages...

[4] https://www.datacenterknowledge.com/uptime/microsoft-blames-...

[ Parent | on HN ]
Re:Google Kubernetes Engine's third consecutive day of servi... by ignoramous on Sunday November 11, 2018 @08:35PM (#18429964)
Can't speak for Google, but Facebook and Salesforce chose Cells for HA.

http://highscalability.com/blog/2012/5/9/cell-architectures....

[ Parent | on HN ]
Re:Google Kubernetes Engine's third consecutive day of servi... by toomuchtodo on Monday November 12, 2018 @01:15PM (#18434396)
Doesn't look like it was all that helpful to Facebook (as of 1542038976). Facebook.com errors out currently.

> Facebook Platform Appears to be down

> A check of https://developers.facebook.com/status/dashboard/ returns an error and I'm unable to login with facebook to some of my mobile apps.

https://news.ycombinator.com/item?id=18434262

[ Parent | on HN ]
Re:Google Kubernetes Engine's third consecutive day of servi... by doodliego on Sunday November 11, 2018 @08:56PM (#18430038)
Look how frequent and detailed Amazon's update logs are in that first Register article. Multiple updates throughout the day going into some detail.
[ Parent | on HN ]