Thundering Herds and Promises

Re:Thundering Herds and Promises by sciurus on Wednesday April 17, 2019 @12:27PM (#19683993)

This is how many HTTP caches and CDNs work. The terminology used to describe it is often request collapsing or request coalescing.

Some examples:

* varnish: https://info.varnish-software.com/blog/hit-for-pass-varnish-...

* nginx: http://nginx.org/en/docs/http/ngx_http_proxy_module.html#pro...

* fastly: https://docs.fastly.com/guides/performance-tuning/request-co...

* cloudfront: https://docs.aws.amazon.com/AmazonCloudFront/latest/Develope...

[ Parent | on HN ]

Re:Thundering Herds and Promises by camelspade on Wednesday April 17, 2019 @12:50PM (#19684223)

Also in Apache Traffic Server through the collapsed forwarding plugin: https://docs.trafficserver.apache.org/en/latest/admin-guide/...

[ Parent | on HN ]

Re:Thundering Herds and Promises by sk5t on Thursday April 18, 2019 @12:38AM (#19688751)

Plain-old-caches and even concurrent-aware maps do this too--several are the cases where I've slapped a Guava or Caffeine cache into place for quick 'n dirty concurrency control and key coalescing, even with a short TTL.

[ Parent | on HN ]