News for hackers. Stuff that matters.
Re:Google Cloud Console Incident by sethvargo on Monday March 11, 2019 @03:23PM (#19361963)
Hey everyone - Seth from Google here. We're aware of this issue and our teams are working to resolve it as quickly as possible. We apologize for any interruption.
Re:Google Cloud Console Incident by ct0 on Monday March 11, 2019 @03:26PM (#19361991)
Thanks Seth!
Re:Google Cloud Console Incident by dejaime on Monday March 11, 2019 @11:01PM (#19364997)
Thanks for the work and for the update
Re:Google Cloud Console Incident by simook on Monday March 11, 2019 @03:15PM (#19361890)
I'm interested in the root cause.

Console operations and architecture for HA is one of my current responsibilities. It's important to me that customers can depend on a functional, responsive, and stable console.

I think the console experience heavily influences the trust and overall customer experience of any service.

Re:Google Cloud Console Incident by WestCoastJustin on Monday March 11, 2019 @03:19PM (#19361928)
100% agree. I wanted to record some screencasts of the interface today and it is a little inconvenient. However, Google has an extremely robust post mortem process and I am sure they will correct things so this specific event does not happen again [1, 2]. They will typically post some type of public boiled down version of the post mortem too. Hopefully that happens in this case!

[1] https://landing.google.com/sre/sre-book/chapters/postmortem-...

[2] https://landing.google.com/sre/sre-book/chapters/postmortem/

Re:Google Cloud Console Incident by sethvargo on Monday March 11, 2019 @03:32PM (#19362025)
Sorry for the interruption. I'm not sure how much information we'll be able to share publicly, but there will definitely be an internal PM once the incident is resolved.
Re:Google Cloud Console Incident by WestCoastJustin on Monday March 11, 2019 @03:37PM (#19362070)
Yeah, I'm sure there is a healthy omg happening right now :)
Re:Google Cloud Console Incident by gouggoug on Monday March 11, 2019 @03:35PM (#19362061)
This is the second time in 2 weeks this happens.

Last time it happened (Tue, Feb 26, around 12:41 PM), my Kubernetes cluster became unresponsive (and my website). I was never able to figure out if that was purely a coincidence or not, but I do not believe it was.

Re:Google Cloud Console Incident by lfx on Monday March 11, 2019 @03:18PM (#19361925)
Also seems BitQuery having issues too.

Wondering if this end up being related with Summer Time change? Happened many times in the past in companies where I worked.

Re:Google Cloud Console Incident by WestCoastJustin on Monday March 11, 2019 @03:27PM (#19361997)
You might be able to use the older interface still (has been working for me) [1]. I think they are testing a new beta interface that is right inside the console. I still like the older interface myself.

[1] https://bigquery.cloud.google.com