Re:When Simple Wins: Power of 2 Load Balancing
by mrkurt on Monday June 26, 2017 @10:49PM
(#14642223)
The problem with load balancing is herd behavior. Stats for load are usually at least a little stale, because it's a distributed system where you can't afford to wait for consistency. When there are traffic spikes a whole herd of new connections will go to the least loaded server for a window of time where the cached "load" number is out of date. Picking two at random helps keep from a bunch of connections racing to one server, even when you're only running 3-4 of them.
[ Parent
| on HN ]
There are no comments on this comment yet.