That might actually be the problem - however, it's kind of a stretch to say it "should" be expressed that way. "Driving A to B" is a common phrase (as for whether it's technically correct, despite the ambiguity of meaning, I actually am not sure).