I take my kids on the NYC subway very often. It isn't emotionally taxing because the vast, vast majority of journeys encounter no issues at all. What you're describing is a self inflicted state of mind.

I don't drive as often but I've run into far more potentially dangerous situations driving on the highway with my kids than I have on the subway.