But that's mitigated by the fact that the failure modes and much, much worse.
I can drive safely at highway speeds with a couple hundred feet of separation between cars.
FAA rules on safe separation between planes laterally is about 3 miles, or about 50 times the distance, or 2500 times the surface area.
Plus planes compete with one another for access to airports, so you haven't actually solved any congestion issues -- the bottleneck is still near the ground.
Flying cars won't use the same airspace as turbine powered airline planes, so a new airspace designation could exist just for cars. And drones. Because drones and flying cars will be competing for the same airspace so all of them will need to use the same system.
Added: Flying cars (and to some degree drones) do compete with the same airspace as existing general aviation flights. And that's a big problem. The legacy aircraft would have to avoid the new airspace, most won't ever get an upgrade to fly autonomously; alternatively, the flying cars will have to be programmed such that they can always yield right of way to legacy aircraft.
At ordinary commercial airline speeds, it's the equivalent of a "20-second rule" (i.e. it's the distance covered in 20 seconds by a 500-600mph vehicle).
Gravitational potential energy is a little more reliable than aircraft engines. if you lose propulsion, you can convert altitude to airspeed at your leisure, subject to the glide ratio. But only if you have it :).
Whatever else goes wrong, being further away from the ground gives you more time to deal with it.
Wouldn't you move it 1,000 feet up, 2,000 feet up, 3,000 feet up...
There's a lot more space in the air than on land.
Plus, in 3D you can make two non-intersecting non-parallel straight paths. Can't do that in 2D.