Re:Fastmail 30 June outage post-mortem
by nik736 on Thursday July 06, 2023 @11:10AM
(#36617203)
You have to plug in the cable somewhere. If the hardware where the x-connect is plugged in dies, has issues, has to be rebooted, etc. you have an issue and it's not like there were no CF issues ever.
[ Parent
| on HN ]
From the post-mortem, it doesn't sound like like the problem was a single network cable. Redundant network switches have existed for a long time, and they're certainly using them (but not bothering to mention it in the post-mortem).
Their problem was that they only have two transit providers, and one of them black-holed about 3-5% of the internet. Since it was a routing issue, I'd guess it was either a misconfiguration, or that the traffic is being split across dozens of paths, and one path had a correlated failure.
Why does there have to be just one cable?
Re:Fastmail 30 June outage post-mortem
by withinboredom on Thursday July 06, 2023 @12:29PM
(#36618499)
Do you think there are two cables that are never bundled in the same underground tube?
All the redundancy in the world can’t protect you from some random person digging in the wrong place.