Getting safer seems like it could be possible, but it's going to be an enormous amount of work.
But someone flying commercially, even in a Cessna is going to have quite a bit more training than Joe Pilot who flys 10 hours a year. A commercial and IFR certificate at the very least, and will also have to pass more stringent and more frequent medical exams.
But just because you aren't doing those things, doesn't make you any less at risk from other people doing those things. You are still on the road, surrounded by, in some areas, hundreds or thousands of deadly machines operated by people who are generally almost capable of handling them.
I just finished an excellent book on this, "A Deadly Wandering", which examines distracted driving specifically but also touches on a few other related subjects. In the primary case that the book follows, and in the few others it mentions, distracted drivers walked away from wrecks where they had killed innocent other passengers or motorists.
Being in a car (or bike, or motorcycle) on the road is one of the most dangerous things the average person does on a regular basis.
I understand that some people have very dangerous commutes, but for some it's literally 10 miles of traffic moving at <10mph 99% of the time. If that's your "driving" then the risk of having a life destroying accident is almost nil and it's probably safer than walking or cycling at that point(you basically sit for an hour in a metal cage that's barely moving, surrounded by other barely moving metal cages).
Yes, there is still a chance someone else around you could be drunk or speeding or distracted, but if you are sitting in an 8-lane jam that's not really going to do much damage.
Still not saying I'm narrowly avoiding death or anything, but man, the sheer volume of people going to work on the interstate every morning and night causes so many wrecks.
Transportation accidents are the leading cause of "unintentional injury" deaths (i.e., not disease, suicide, or homicide) [1]. Although the absolute rates are somewhat low (7.28 fatalities per billion miles for cars and light trucks), you are approximately 100 times more likely to die while driving than flying (table 2 in [1]).
[1]: http://faculty.wcas.northwestern.edu/~ipsavage/436.pdf