Re:Using load shedding to survive a success disaster - CRE l...
by ChuckMcM on Monday December 19, 2016 @07:26PM
(#13216296)
We did this very successfully at Blekko (search engine) to keep the system from getting over loaded. The frontend engineer Bryn designed a really useful way of monitoring nginx connections to the backend and to shed load when they exceeded a threshold, and Greg designed a 'geoknob' that would let us turn off traffic to regions of the world that were unlikely to be our primary customer base.
Also anomalous load shedding is a great indication of a traffic anomaly. Big scrapers sometimes appeared that way first even when their attack was coming from a wide number of IPs.
Also anomalous load shedding is a great indication of a traffic anomaly. Big scrapers sometimes appeared that way first even when their attack was coming from a wide number of IPs.