That's actually a really interesting idea - hand off driving to a remote person when the conditions are bad.

But would a car's connectivity and latency allow for that to be safe?

Edit: If not there would still be some form control needed for the passenger.