News for hackers. Stuff that matters.
Re:Multiple Digital Ocean services down by wesammikhail on Tuesday November 18, 2025 @09:33AM (#45966632)
slight off topic: I used DO LBs for a little while but found myself moving away from that toward a small droplet with haproxy or nginx setup. Worked much better for me personally!
Re:Multiple Digital Ocean services down by showerst on Tuesday November 18, 2025 @10:17AM (#45967348)
The point of an LB for these projects is to get away from a single point of failure, and I find configuring HA and setting up the networking and everything to be a pain point.

These are all low-traffic projects so it's more cost effective to just throw on the smallest LB than spend the time setting it up myself.

Re:Multiple Digital Ocean services down by grayhatter on Tuesday November 18, 2025 @10:56AM (#45967940)
If they are small projects, why are they behind a load balancer to begin with?
Re:Multiple Digital Ocean services down by showerst on Tuesday November 18, 2025 @12:16PM (#45969145)
I use the LB's for high availability rather than needing load balancing. The LB + 2 web back-ends + Managed DB means a project is resilient to a single server failing, for relatively low devops effort and around $75/mo.
Re:Multiple Digital Ocean services down by grayhatter on Tuesday November 18, 2025 @02:00PM (#45970454)
Are both servers deployed from the exact same repo/scripts? Or are they meaningful different, and/or balanced across multiple data centers?

Did your high availability system survive this outage?

Re:Multiple Digital Ocean services down by showerst on Tuesday November 18, 2025 @02:43PM (#45971030)
I have a couple of instances of this same pattern for various things that have been running for 5+ years, none of them have suffered downtime caused by the infrastructure. I use ansible scripts for the web servers, and the DO API or dashboard to provision the Load Balancer and Database. You can get it all hooked up in a half hour, and it really doesn't take any maintenance other than setting up good practices for rotating the web servers out for updates.

They wouldn't survive DO losing a DC, they're not so mission critical that it's worth the extra complexity to do that, and I don't recall DO losing a DC in the past 10 years or so.

They did stay up during this outage, which was apparently mostly concentrated on a different product called the 'global load balancer', which ironically is exactly the extra complexity I mentioned to in theory survive a DC outage.

Keep in mind these are "important" in the sense that they justify $100/mo on infra and monitoring, but not "life critical" in that an outage is gonna kill somebody or cost millions of bucks an hour. Once your traffic gets past a certain threshold, DO's costs don't scale that well and you're better off on a large distributed self-managed setup on Hetzner or buying into a stack like AWS.

To me their LB and DB products hit a real sweet spot -- better reliability than one box, and meaningfully less work than setting up a cluster with floating IP and heartbeats and all that for a very minimal price difference.

Re:Multiple Digital Ocean services down by nickmonad on Tuesday November 18, 2025 @11:15AM (#45968177)
Usually because of SSL termination. It's generally "easier" to just let DO manage getting the cert installed. Of course, there are tradeoffs.