That's why you need advanced auto-pilot before this is feasible. And bear in mind that there's a lot more room for collision avoidance in the air. You'd probably have to have something like special lanes in the air to minimize the number of directions that another vehicle could approach, and to keep them out of the commercial airspace. You'd need a special license to go "off-road".
Granted, I was just in an accident a few weeks ago, and it dramatically changed my view on driving altogether. Crashes aren't just something that happens "to someone else". People are very irresponsible, reckless, and impatient when it comes to moving vehicles.