Re:Why is load balancing gRPC tricky?
by morelisp on Friday May 14, 2021 @12:28PM
(#27156102)
As a concrete case of what EricBurnett says, we have a service that has a "long" warmup (p99 30ms - you can think of it like loading a symbol table) but then very fast requests once that data is loaded (p99 about 400usec, fast specifically because it can exchange indexes into the shared symbol table and not full data).
[ Parent
| on HN ]
There are no comments on this comment yet.