But what if you have long lived stateful connections? And you don't want a deploy to take forever?

Ofc you can say "don't do that" but sometimes it's just the way it is...

But I agree, 99% of the time a rolling update is easier and works fine.