Applying any level of systems thinking or lifecycle analysis to the problem will reveal that nearly none of the costs to the environment or society are paid by whatever cursory fee you pay at the pump. Most of those taxes are paid by everyone regardless of car ownership anyway.