Sure there will be problems. Regardless, the suggestion that "they're going to take your car away" is FUD. No one wants to do that. If a robocar can't handle a human driver in the next lane then it can't handle any number of other common and unpreventable factors.