Re:Cloudflare outage on November 18, 2025 post mortem
by kevin_thibedeau on Tuesday November 18, 2025 @11:29PM
(#45975854)
It's reasonable when testing protocols exercise the panic scenario. This is the problem with punting on error recovery. Nobody checks faults that propagate across domains of responsibility.
Re:Cloudflare outage on November 18, 2025 post mortem
by AtNightWeCode on Wednesday November 19, 2025 @12:19AM
(#45976131)
Exactly. The newbie mistake in SQL is also way worse than this. But the whole design is also bad. Clearly implementing things at the wrong place.
And, it took like over an hour between the problem started til my sites went down. That is just crazy.
Re:Cloudflare outage on November 18, 2025 post mortem
by thatoneengineer on Wednesday November 19, 2025 @12:20AM
(#45976135)
I agree there's no way to soft-error this, though "truncate and raise an alert" is arguably the better pattern.
The config bug reaching prod without this being caught and pinpointed immediately is the strange part.