Re:Espresso – Google’s peering edge architecture
by pas on Wednesday April 05, 2017 @12:15PM
(#14043177)
Yes, that's about right. Since they control both sides of the link, they can manage the flow from higher up on the [software] stack. Basically, if the link is getting saturated, the distributed system simply throttles some requests upstream by diverting traffic from places that result in traffic over that link. (And of course this requires a very complex control plane, but doable, and with proper [secondary] controls it probably stays understandable, manageable, and doesn't go haywire when shit hits the fan.)
[ Parent
| on HN ]
Re:Espresso – Google’s peering edge architecture
by collinmanderson on Thursday April 06, 2017 @10:08AM
(#14050603)
So I wonder if that means they can do TCP control flow without dropping packets.
Re:Espresso – Google’s peering edge architecture
by pas on Tuesday April 11, 2017 @05:48AM
(#14086206)
I guess they do drop packets (it's the best - easiest/cheapest/cleanest - way to backpropagate pressure - aka backpressure), but they watch for it a lot more vigorously. Also as I understand they try to separate long lived connections (between DCs) from internal short lived traffic. Different teams, different patterns, different control structures.