I feel for you. I was the same way. I just internalized the stats and remind myself of them every time I fly. As a numbers guy, I simply cannot justify my abject fear compared to being a pedestrian or auto driver.

Another thing I do is to remember the physics when I'm on a bumpy. Thanks to momentum, planes don't just fall out of the sky, and even bad turbulence is not likely to result in deaths.