Re:Roblox October Outage Postmortem
by Twirrim on Thursday January 20, 2022 @05:27PM
(#30016134)
The post indicates they'd been rolling it out for months, and indicate the feature went live "several months ago".
With the behaviour matching other types of degradation (hardware), it's entirely reasonable that it could have taken quite a while to recognise that software and configurations that have proven stable for several months, that is still there working, wasn't quite so stable as it seemed.
Re:Roblox October Outage Postmortem
by nightpool on Thursday January 20, 2022 @05:37PM
(#30016277)
Right, but it only went live on the DB that failed the day before. Obviously, hindsight is 20/20, but it's strange that the oversight didn't rate a mention in the postmortem.
With the behaviour matching other types of degradation (hardware), it's entirely reasonable that it could have taken quite a while to recognise that software and configurations that have proven stable for several months, that is still there working, wasn't quite so stable as it seemed.