Just to put some numbers on this, in 2010 (the last year I could find stats on with lazy Googling) there were 267 fatal GA crashes with 453 fatalities in the US. There were no airliner fatalities in the US, just like most years in the past decade.

While I'm at it, there were 32,788 automobile traffic fatalities in 2010 in the US, although of course there's vastly more car activity than GA activity.