Re:Programming Culture in the Late Aughts
by marginalia_nu on Thursday June 08, 2023 @05:34AM
(#36239275)
HTTP/2 does mitigate this a bit, I think it's mostly just a limitation in the number of threads. Even with pools or green threads, a CPU can only do so many things in parallel.
Context switching is expensive.
Even (or maybe especially?) popular products like Gmail are guilty of this, sending easily over 200 requests. That's 700ms(!) worth of stalled requests in the best case scenario.