News for hackers. Stuff that matters.
Re:Cloudflare outage on November 18, 2025 post mortem by kevincox on Wednesday November 19, 2025 @07:31AM (#45978814)
I'm shocked that an automatic canary rollout wasn't an action item. Pushing anything out globally is a guaranteed failure again in the future.

Even if you want this data to be very fresh you can probably afford to do something like:

1. Push out data to a single location or some subset of servers.

2. Confirm that the data is loaded.

3. Wait to observe any issues. (Even a minute is probably enough to catch the most severe issues.)

4. Roll out globally.

There are no comments on this comment yet.