The design you propose is stateful, and if you read the chapter closely, you can see we spend a lot of effort to make things stateless.
The main thing I wanted to respond to in this thread about a single bad server destroying your yearly SLO is described in the first paragraph in the section on load balancing at the virtual IP address.
Re:What happens when you update your DNS
by blueblisters on Tuesday June 23, 2020 @05:01AM
(#23611480)
Sorry I couldn't find a clear rationale in the link. Why does Google prefer a stateless load balancer? Is it infeasible to maintain state at that scale?
Sorry, I didn't read the document that closely. It was a bit too long.
Overall, virtual IPs are still an interesting solution.
You might like the actual paper: https://static.googleusercontent.com/media/research.google.c...
It might be a little more resilient than even a very minimal nginx, but more than that, I think it must give you more control about what happens when a packet is not "answered" after some set amount of time - you write off who should have been the answerer, then resend that same packet to another server. Keep a buffer of packet, scrape them from the buffer when ACK'ed by the answerer, resend them to another answerer if not ACK'ed after some set amount of time.
Am I guessing correctly?
It seems a bit overcomplicated for normal usecases, but adequate for a large scale like google.