You are assuming that the driver's phone is the one connected. The typical use case is a couple, where either can drive. The first one to look up directions is the one who connects the phone. I do this all the time with my wife. Sometimes we have to disconnect one phone and connect the other so the passenger can continue using the phone without killing the map for the driver.