Re:A self-killing web site requested by a customer (2011)
by MichaelApproved on Thursday May 07, 2020 @09:09AM
(#23102522)
Maybe their “load balancer” was just a simple round robin service which wouldn’t have those abilities.
An even better loadbalancer will poll a load endpoint, representing CPU load, queue length, percentage of time GC'ing, or some similar metric, and scale back requests as that metric gets too high.