Yes, it seems like a server side complexity issue should be a fixable problem without updating the standards.

I suppose you'll still need to deploy a stun/turn server to deal with the NAT issues unless you're happy with IPv6 only, but that's not really something the standard can fix.