Re:The State of Async Rust
by Matthias247 on Monday September 25, 2023 @03:52PM
(#37649631)
That's assuming no concurrency, which isn't applicable. Every public CDN will have around 10ms latency per request (because it takes time to load data from disk, fetch from upstream servers, apply WAF rules, etc). But they still handle 5 digits of requests per second.
Latency is not directly related to throughput.