Re:Show HN: Self-host open-source LLMs on AWS with scale-to-...
by paguasmar on Wednesday September 09, 2026 @07:38AM
(#49624797)
Great question. The controller provision a replacement automatically. The controller runs continuous health-check polls against the worker’s, if it doesn't respond, provisions a new one.
Why not use a AASG?
I chose to use a controller to make the solution cloud agnostic.
Why not use a AASG?
I chose to use a controller to make the solution cloud agnostic.