Re:Google Services Experiencing Disruptions
by nonbirithm on Thursday September 24, 2020 @09:34PM
(#24585709)
It makes me wonder if it has anything to do with GCP. Pure speculation, but if it's in the cloud then they probably wouldn't hesitate to dogfood their own platform. But then it would be interesting since search still works. Maybe search was too high-value to risk having a hard dependency on whatever it is that is causing the outage.
[ Parent
| on HN ]
Re:Google Services Experiencing Disruptions
by dodobirdlord on Friday September 25, 2020 @12:19AM
(#24586540)
Google has an internal cloud that they talk about sometimes. Borg, bigtable, spanner, etc. They run all their services on their internal cloud, including their public cloud, with the exception of Compute Engine, which is its own thing.
Re:Google Services Experiencing Disruptions
by jsolson on Friday September 25, 2020 @02:43AM
(#24587167)
Compute Engine isn't really a separate thing so much as it's another thing built on the same infra. All the way down to the individual VMs, it runs on Google's production infrastructure and is scheduled by Borg (onto dedicated machine pools, although that sort of dedicated resource pooling is not unique to GCE). Once you get into VM networking things get a bit more exotic, although all of that still runs atop the same software defined network infrastructure as everything else (but, much like with Borg, it uses more features than many workloads at Google).
(I work on Compute Engine's virtualization infrastructure)
Re:Google Services Experiencing Disruptions
by dodobirdlord on Friday September 25, 2020 @02:38PM
(#24592816)
Thanks for the clarification! I had heard that Compute Engine ran on dedicated machines, but was under the impression that approach was unique to GCE.
Re:Google Services Experiencing Disruptions
by grumblez on Thursday September 24, 2020 @10:09PM
(#24585893)
There was interruption between GCP's monitoring & services on GCP. I also have my own Prometheus/Grafana stack in there and it kept chugging along fine, even though their DB graphs show severe dips in tx/sec in the time period in question.