Caches, Modes, and Unstable Systems

Re:Caches, Modes, and Unstable Systems by l0k3ndr on Sunday August 29, 2021 @04:25AM (#28345105)

Nice read. Just curious that isn't this handled via rate throttling at load-balancer/gateway level? Like only forward requests to database as much as it can handle?

[ Parent | on HN ]

Re:Caches, Modes, and Unstable Systems by ignoramous on Sunday August 29, 2021 @05:44AM (#28345455)

That introduces a "mode"? In fact load-balancers / traffic-shaping themselves can misoperate often resulting in catastrophic consequences.

See chapters 19 to 22: https://sre.google/sre-book/load-balancing-frontend/

[ Parent | on HN ]

Re:Caches, Modes, and Unstable Systems by tyingq on Sunday August 29, 2021 @07:58AM (#28346009)

I like the idea of priority queues driven by number of prior successful requests + wait time. Such that once you're in, you get reasonable performance, otherwise you get 503 "too busy" until you've waited.

[ Parent | on HN ]