News for hackers. Stuff that matters.

A comment on Show HN: Run globally distributed full-stack apps on high-performance MicroVMs.

Re:Show HN: Run globally distributed full-stack apps on high... by emschwartz on Thursday August 17, 2023 @05:15PM (#37168196)
My understanding is that Fly.io also started using Nomad but ended up running into big reliability issues at scale across many regions. I'm curious if you all are using it differently or haven't gotten to that scale yet.
[ Parent | on HN ]
Re:Show HN: Run globally distributed full-stack apps on high... by crabmusket on Thursday August 17, 2023 @05:49PM (#37168621)
Source: https://fly.io/blog/carving-the-scheduler-out-of-our-orchest...
[ Parent | on HN ]
Re:Show HN: Run globally distributed full-stack apps on high... by yann_eu on Thursday August 17, 2023 @06:16PM (#37168934)
I’d say we don’t use it exactly the same way: we don’t have a single global nomad cluster, which is a critical difference.

We have one Nomad cluster per region, which we “federated” ourselves using our own orchestrator. This basically reduces the latencies between agents and each cluster, reduces the failure domains, and also avoids encoding all the constraints in one single Nomad job definition.

I'm not so much worried about scaling with our setup but the performance of the autoscaler might be a concern in the future.

[ Parent | on HN ]