Re:Money Trees – Rap Genius Response to Heroku
by bumbledraven on Tuesday February 19, 2013 @04:34PM
(#5247199)
Wow, the gain from using two choices is indeed impressive! According to section 3.6 (page 72): ``[For a system with 500 servers, i]n equilibrium, the expected time a [request] spends in the system given one choice (d=1) is 1/(1-λ) {where λ is the average request rate}. Hence ... when λ = 0.99 the expected time in the system when d = 1 is 100.00; with two choices {when d=2}, this drops to under 6.''
Oh, and it also scales incredibly well. Like I said, there's no reason not to use it over purely random load balancing.
[0] http://www.eecs.harvard.edu/~michaelm/postscripts/mythesis.p...