News for hackers. Stuff that matters.
Re:Cloudflare outage on November 18, 2025 post mortem by dwattttt on Wednesday November 19, 2025 @02:35AM (#45976827)
> It looks like changing the permissions triggered creation of a new feature file, and it was ingestion of that file leading to blowing a size limit that crashed the systems.

That feature file is generated every 5 minutes at all times; the change to permissions was rolled out gradually over the clickhouse cluster, and whether a bad version of that file was generated depended on whether the part of the cluster that had the bad permissions generated the file.

There are no comments on this comment yet.