Re:What Happened to Facebook, Instagram, and WhatsApp?
by regnull on Monday October 04, 2021 @04:52PM
(#28751941)
Having worked for a similar company, I remember there were some good old IRC servers up and running to communicate in an emergency just like that.
Re:What Happened to Facebook, Instagram, and WhatsApp?
by makeworld on Monday October 04, 2021 @05:02PM
(#28752040)
Facebook has this too, but they require facebook.com DNS to work, so they are also down.
Re:What Happened to Facebook, Instagram, and WhatsApp?
by seaman1921 on Monday October 04, 2021 @04:30PM
(#28751692)
Nice try, but they have separate communication channels for SREs so don't worry.
Re:What Happened to Facebook, Instagram, and WhatsApp?
by jrodthree24 on Monday October 04, 2021 @04:37PM
(#28751774)
You mean they don't receive all their alerts through facebook messenger?
Re:What Happened to Facebook, Instagram, and WhatsApp?
by coldcode on Monday October 04, 2021 @05:04PM
(#28752065)
Thanos snapped his fingers and Zuckerberg vanished with the keys.
My (very large) employer had a worldwide outage a few years ago where a single bad DNS update stopped everything in its tracks (at the time many things were still in our own data centers, now more is in Amazon/etc). It took most of the day to restart everything. But it's not something most people would have noticed like FB. Thankfully I worked in mobile so not involved.
Re:What Happened to Facebook, Instagram, and WhatsApp?
by manquer on Monday October 04, 2021 @09:04PM
(#28754362)
It is hard to balance dogfooding (good) with SPOF (bad), many big companies do get it wrong (AWS with S3, Slack in the recent past) all the time.
It is easy to get it wrong if your company provides internet services that every developer typical depends in their workflows and to keep educating your own developers on how to use them and when not to use your own services.
SinglePointOfFailure.NoRedundancies.FB