Commercial planes are inspected regularly by qualified technicians, flown by professional pilots, and they don't fly between buildings in densely populated areas. Imagine if every average joe owned a helicopter, and maintained it the way he maintains his rusty old car... Small planes don't have nearly the safety record of commercial planes, and if everyone owned aerial vehicles that fly inside cities, you can be sure it would be a disaster.

I think there's an argument to be made that if flying cars were owned by a company like Uber, regularly inspected, and flown by a computer, the safety could be there, but then you're still left with issues such as noise and energy efficiency.