News for hackers. Stuff that matters.
Re:Google cloud Europe is out by pjc50 on Wednesday April 26, 2023 @10:01AM (#35713780)
I'm not sure what the disk encryption story is in Google Cloud but I'd rather it didn't end up on Ebay. Mind you, "flooded" covers a wide range of possibilities and a surprisingly small amount of water ingress would trip a breaker while leaving the racks in good order.
Re:Google cloud Europe is out by antonvs on Wednesday April 26, 2023 @10:16AM (#35714018)
> a surprisingly small amount of water ingress would trip a breaker while leaving the racks in good order.

If that were the case they wouldn't be saying "There is no current ETA for recovery," and "it is expected to be an extended outage. Customers are advised to failover to other regions."

Re:Google cloud Europe is out by Xylakant on Wednesday April 26, 2023 @10:24AM (#35714130)
Starting up a cloud region after a total shutdown is likely an untested procedure with no well known timeframe, even if the hardware is ok.
Re:Google cloud Europe is out by dannyw on Wednesday April 26, 2023 @11:22AM (#35715138)
If you're in the business of being a massive cloud provider, hopefully restarting a region is not an untested procedure for you.

You could always test this in a live environment before a region becomes open to customers.

Re:Google cloud Europe is out by smueller1234 on Wednesday April 26, 2023 @12:14PM (#35716100)
You're right. It's not untested at all. It's just not instantaneous, unfortunately. :)
Re:Google cloud Europe is out by Xylakant on Wednesday April 26, 2023 @12:34PM (#35716404)
“Test in a live environment before the region becomes open to customers” is a test that’s not entirely representative for “the region had an emergency shutdown with customers on it.” And the latter is something that you can’t reliably test obviously - unless you decide to crash a whole region in live traffic.
Re:Google cloud Europe is out by CydeWeys on Wednesday April 26, 2023 @11:33AM (#35715384)
There's a lot more to a datacenter building than just the servers sitting on racks. In particular here there was a fire in the power-serving infrastructure (caused by the flood presumably). So nearly all of those servers could be totally fine, just off, but if the power distribution network in the building is literally fried, that's gonna take a long time to fix.
Re:Google cloud Europe is out by packetslave on Wednesday April 26, 2023 @02:55PM (#35718358)
Having (for example) 6 inches of water in your 115kV switch room is a small-scale problem that can cause a large-scale outage.
Re:Google cloud Europe is out by briffle on Wednesday April 26, 2023 @10:12AM (#35713956)
All data in encrypted at rest, and all hard drives are destroyed on site.