News for hackers. Stuff that matters.
Re:Cloudflare is down by pm90 on Friday December 05, 2025 @03:53AM (#46158234)
This is not good. One major outage? Something exceptional. Several outages in a short time? As someone thats worked in operations, I have empathy; there are so many “temp havks” that are put in place for incidents. but the rest of the world won’t… they’re gonna suffer a massive reputation loss if this goes on as long as the last one.
Re:Cloudflare is down by berkes on Friday December 05, 2025 @04:07AM (#46158529)
At least this warrants a good review of anyone's dependency on cloudflare.

If it turns out that this was really just random bad luck, it shouldn't affect their reputation (if humans were rational, that is...)

But if it is what many people seem to imply, that this is the outcome of internal problems/cuttings/restructuring/profit-increase etc, then I truly very much hope it affects their reputation.

But I'm afraid it won't. Just like Microsoft continues to push out software, that, compared to competitors, is unstable, insecure, frustrating to use, lacks features, etc, without it harming their reputation or even bottomlines too much. I'm afraid Cloudflare has a de-facto monopoly (technically: big moat) and can get away with offering poorer quality, for increasing pricing by now.

Re:Cloudflare is down by coffeebeqn on Friday December 05, 2025 @04:11AM (#46158637)
Vibe infrastructure
Re:Cloudflare is down by rvz on Friday December 05, 2025 @04:16AM (#46158729)
So that is what the best case definition of what "Vibe Engineering" is.
Re:Cloudflare is down by MrAureliusR on Friday December 05, 2025 @04:20AM (#46158790)
well that's the thing, such a huge number of companies route all their traffic through Cloudflare. This is at least partially because for a long time, there was no other company that could really do what Cloudflare does, especially not at the scales they do. As much as I despise Cloudflare as a company, their blog posts about stopping attacks and such are extremely interesting. The amount of bandwidth their network can absorb is jaw-dropping.

I've said to many people/friends that use Cloudflare to look elsewhere. When such a huge percentage of the internet flows through a single provider, and when that provider offers a service that allows them to decrypt all your traffic (if you let them install HTTPS certs for you), not only is that a hugely juicy target for nation-states but the company itself has too much power.

But again, what other companies can offer the insane amount of protection they can?

Re:Cloudflare is down by zelphirkalt on Friday December 05, 2025 @04:58AM (#46159200)
Microsoft's reputation couldn't be much lower at this point, that's their trick.

The issue is the uninformed masses being led to use Windows when they buy a computer. They don't even know how much better a system could work, and so they accept whatever is shoved down their throats.

Re:Cloudflare is down by rsynnott on Friday December 05, 2025 @05:16AM (#46159320)
> Just like Microsoft continues to push out software, that, compared to competitors, is unstable, insecure, frustrating to use, lacks features, etc, without it harming their reputation or even bottomlines too much.

Eh.... This is _kind_ of a counterfactual, tho. Like, we are not living in the world where MS did not do that. You could argue that MS was in a good place to be the dominant server and mobile OS vendor, and simply screwed both up through poor planning, poor execution, and (particularly in the case of server stuff) a complete disregard for quality as a concept.

I think someone who'd been in a coma since 1999 waking up today would be baffled at how diminished MS is, tbh. In the late 90s, Microsoft practically _was_ computers, with only a bunch of mostly-dying UNIX vendors for competition. And one reasonable lens through which to interpret its current position is that it's basically due to incompetence on Microsoft's part.

Re:Cloudflare is down by gbrindisi on Friday December 05, 2025 @06:43AM (#46159989)
The crowdstrike incident taught us that no one is going to review any dependency whatsoever.
Re:Cloudflare is down by ezst on Friday December 05, 2025 @07:11AM (#46160228)
Yep, that's what late stage capitalism leaves you with: consolidation, abuse, helplessness and complacency/widespread incompetence as a result
Re:Cloudflare is down by pyuser583 on Friday December 05, 2025 @04:09AM (#46158566)
Lots of big sites are down
Re:Cloudflare is down by karmakurtisaani on Friday December 05, 2025 @03:58AM (#46158336)
Probably fired a lot of their best people in the past few years and replaced it with AI. They have a de-facto monopoly, so we'll just accept it and wait patiently until they fix the problem. You know, business as usual in the grift economy.
Re:Cloudflare is down by 5d41402abc4b on Friday December 05, 2025 @04:16AM (#46158739)
>They have a de-facto monopoly

On what? There are lots of CDN providers out there.

Re:Cloudflare is down by esseph on Friday December 05, 2025 @04:31AM (#46158938)
They do fare more than just CDN. It's the combination of service, features, reach, price, and the integration of it all.
Re:Cloudflare is down by immibis on Friday December 05, 2025 @04:28AM (#46158898)
There's only one that lets everyone sign up for free.
Re:Cloudflare is down by rvz on Friday December 05, 2025 @04:18AM (#46158769)
The "AI agents" are on holiday when an outage like this happens.
Re:Cloudflare is down by mvdtnz on Friday December 05, 2025 @12:41PM (#46164567)
This didn't happen at all. You're just completely making shit up.
Re:Cloudflare is down by karmakurtisaani on Sunday December 07, 2025 @05:07AM (#46180585)
Yeah I am a bit.
Re:Cloudflare is down by rvz on Friday December 05, 2025 @04:02AM (#46158418)
We are now seeing which companies do not consider the third party risk of single point of failures in systems they do not control as part of their infrastructure and what their contingency plan is.

It turns out so far, there isn't one. Other than contacting the CEO of Cloudflare rather than switching on a temporary mitigation measure to ensure minimal downtime.

Therefore, many engineers at affected companies would have failed their own systems design interviews.

Re:Cloudflare is down by cryptonym on Friday December 05, 2025 @04:16AM (#46158728)
Sometimes it's not worth it. Your plan is just to accept you'll be off for a day or two, while you switch to a competitor.
Re:Cloudflare is down by rvz on Friday December 05, 2025 @07:04AM (#46160163)
Can't say that when it is a time critical service such as hospitals, banks, financial institutions or air-traffic control services.
Re:Cloudflare is down by cryptonym on Friday December 05, 2025 @09:49AM (#46162020)
Only a fool would build an architecture for critical air-traffic with Cloudflare as a SPoF.
Re:Cloudflare is down by rvz on Saturday December 06, 2025 @05:52PM (#46177324)
My point still stands.

Having no backup / contingency plan even if any third party system goes down on a time critical service means that you want to risk another disaster around the corner.

In those industries, accepting to wait for them for a "day or two" is not only unacceptable, it isn't even an option.

Re:Cloudflare is down by creamyhorror on Friday December 05, 2025 @08:51AM (#46161260)
If there's a fitting competitor worth switching to.

Plus most people don't get blamed when AWS (or to a lesser extent Cloudflare) goes down, since everyone knows more than half the world is down, so there's not an urgent motivation to develop multi-vendor capability.

Re:Cloudflare is down by throwaway42346 on Friday December 05, 2025 @04:23AM (#46158833)
Alternative infrastructure costs money, and it's hard to get approval from leadership in many cases. I think many know what the ideal solution looks like, but anything linked to budgets is often out of the engineer's hands.

In some cases it is also a valid business decision. If you have 2 hour down time every 5 years, it may not have a significant revenue impact. Most customers think it's too much bother to switch to a competitor anyway, and even if it were simple the competition might not be better. Nobody gets fired for buying IBM

The decision was probably made by someone else who moved on to a different company, so they can blame that person. It's only when down time significantly impacts your future ARR (and bonus) that leadership cares (assuming that someone can even prove that they actually lose customers).

Re:Cloudflare is down by formerly_proven on Friday December 05, 2025 @05:00AM (#46159216)
On the other thread there were comments claiming it’s unknowable what IaaS some SaaS is using, but SaaS vendors need to disclose these things one way or another, e.g. DPAs. Here is for example renders list of subprocessors: https://render.com/security

It’s actually fairly easy to know which 3rd party services a SaaS depends on and map these risks. It’s normal due diligence for most companies to do so before contracting a SaaS.

Re:Cloudflare is down by PlotCitizen on Friday December 05, 2025 @03:59AM (#46158360)
This is a good reminder for everyone to reconsider making all of their websites depend on a single centralized point of failure. There are many alternatives to the different services which Cloudflare offers.
Re:Cloudflare is down by berkes on Friday December 05, 2025 @04:13AM (#46158669)
But the nature of a CDN and most other products CF offers, is central by nature.

If you switch from CF to the next CF competitor, you've not improved this dependency.

The alternative here, is complex or even non-existing. Complex would be some system that allows you to hotswap a CDN, or to have fallback DDOS protection services, or to build you own in-house. Which, IMO, is the worst to do if your business is elsewhere. If you sell, say, petfood online, the dependency-risk that comes with a vendor like CF, quite certainly is less than the investment needed- and risk associted with- building a DDOS protection or CDN on your own; all investment that's not directed to selling more pet-food or get higher margins at doing so.

Re:Cloudflare is down by agnivade on Friday December 05, 2025 @04:22AM (#46158814)
You can load-balance between CDN vendors as well
Re:Cloudflare is down by otikik on Friday December 05, 2025 @04:49AM (#46159134)
Then your load balancer becomes the single point of failure.
Re:Cloudflare is down by roryirvine on Friday December 05, 2025 @06:04AM (#46159687)
BGP Anycast will let you dynamically route traffic into multiple front-end load balancers - this is how GSLB is usually done.

Needs an ASN and a decent chunk of PI address space, though, so not exactly something a random startup will ever be likely to play with.

Re:Cloudflare is down by DaanDL on Friday December 05, 2025 @06:20AM (#46159810)
Then add a load balancer in front of your load balancer, duh. /s
Re:Cloudflare is down by sofixa on Friday December 05, 2025 @05:03AM (#46159238)
With what? The only (sensible) way is DNS, but then your DNS provider is your SPOF. Amazon used to run 2 DNS providers (separate NS from 2 vendors for all of AWS), but when one failed, there was still a massive outage.
Re:Cloudflare is down by altmanaltman on Friday December 05, 2025 @05:02AM (#46159230)
yeah there is no incentive to do a CDN in house, esp for businesses that are not tech-oriented. And the costs of the occasional outage has not really been higher than the cost of doing it in-house. And I'm sure other CDNs gets outages as well, just CF is so huge everyone gets to know about it and it makes the news
Re:Cloudflare is down by Zambyte on Saturday December 06, 2025 @12:02PM (#46174803)
IPFS is a decentralized CDN.
Re:Cloudflare is down by coffeebeqn on Friday December 05, 2025 @04:12AM (#46158659)
We just love to merge the internet into single points of failure
Re:Cloudflare is down by phatfish on Friday December 05, 2025 @04:54AM (#46159174)
This is just how free markets work, on the internet with no "physical" limitations it is simply accelerated.

Left alone corporations to rival governments emerge, which are completely unaccountable. At least there is some accountability of governments to the people, depending on your flavour of government.

Re:Cloudflare is down by mschuster91 on Friday December 05, 2025 @04:56AM (#46159186)
no one loves the need for CDNs other than maybe video streaming services.

the problem is, below a certain scale you can't operate anything on the internet these days without hiding behind a WAF/CDN combo... with the cut-off mark being "we can afford a 24/7 ops team". even if you run a small niche forum no one cares about, all it takes is one disgruntled donghead that you ban to ruin the fun - ddos attacks are cheap and easy to get these days.

and on top of that comes the shodan skiddie crowd. some 0day pops up, chances are high someone WILL try it out in less than 60 minutes. hell, look into any web server log, the amount of blind guessing attacks (e.g. /wp-admin/..., /system/login, /user/login) or path traversal attempts is insane.

CDN/WAFs are a natural and inevitable outcome of our governments and regulatory agencies not giving a shit about internet security and punishing bad actors.

Re:Cloudflare is down by koakuma-chan on Friday December 05, 2025 @04:08AM (#46158538)
My Cloudflare Pages website works fine.
Re:Cloudflare is down by inferiorhuman on Friday December 05, 2025 @05:22AM (#46159367)

  There are many alternatives
Of varying quality depending on the service. Most of the anti-bot/catpcha crap seems to be equivalently obnoxious, but the handful of sites that use PerimeterX… I've basically sworn off DigiKey as a vendor since I keep getting their bullshit "press and hold" nonsense even while logged in.

I don't like that we're trending towards a centralized internet, but that's where we are.

Re:Cloudflare is down by belter on Friday December 05, 2025 @04:49AM (#46159133)
This will be another post-mortem of...config file messed...did not catch...promise to be doing better next....We are sorry.

They problem is architectural.

Re:Cloudflare is down by lucyjojo on Friday December 05, 2025 @06:54PM (#46168989)
cloudflare is a huge system in active development.

it will randomly fail. there is no way it cannot.

there is a point where the cost to not fail simply becomes too high.

Re:Cloudflare is down by jcmfernandes on Friday December 05, 2025 @05:16AM (#46159324)
Absolutely. I wouldn’t be surprised if they turned the heat up a little after the last incident. The result? Even more incidents.
Re:Cloudflare is down by bluerooibos on Friday December 05, 2025 @06:16AM (#46159782)
I'm quite sure the reputational damage has already been done.

How do they not have better isolation of these issues, or redundancy of some sort?

Re:Cloudflare is down by brandensilva on Friday December 05, 2025 @08:25AM (#46160954)
The seed has been planted. It will take awhile for others to fill the void. Still the big players see this as an opportunity to steal market share if Cloudflare cannot live up to their reputation.
Re:Cloudflare is down by wooque on Friday December 05, 2025 @06:31AM (#46159892)
2 days ago they had outage that affected Europe, Cloudflare seems to be going down the drain. I removed it for my personal sites.