Compare this to a car: 1. Setup time: 10 seconds, turn ignition and go. 2. Weather: Who gives a fuck about weather, you can drive in snowstorms, rain, shine and it will do it. Maybe in the rare, rare major snowstorm, you have to do 20 minutes of setup before hand. 3. Cargo: You don't have to think about it 4. Passengers: You don't have to think about it 5. NYC Parking fees: You have to pay hangar fees anyway, and the world is not NYC. 6. Maintenance: You can bloody let your oil leak for a while, and it isn't $5000 to repair it! 7. Training: Usually free, or $1000 and you can become competent in months!! 8. Driving plans: You don't have to register a single car drive to anywhere! 9. Traffic stress: Traffic stress and the 7 things you have to juggle with flying is about the same! (Unless you have nice, expensive systems that do a lot of it for you). 10. Price: ALOT CHEAPER!
People fly GA for the pleasure of flying, not because it's necessarily better than a car, or commercial flights. It is the last bastion of the very well off. You'll still get harassed by customs & co. with a GA plane as you would with a normal flight.
The safest thing you could do is sit home on your computer all day, it would also be extremely boring. Life is not made up of driving to and from a cubicle and typing on a computer. I would much rather take the 0.0001% chance of dieing while doing something fun than the 100% chance of living an entire life that is devoid of any meaningful experiences.