"and the poor suffer what they must"

Should we make our roads more unsafe in an absolute sense out of some misplaced idea of fairness?

This is an absurd framing that presupposes roads are closed to the poor already (they're not) and that fairness is misplaced (it isn't). Wealth should not be a factor in whether one can hold a driver's license or not. Everyone pays road taxes.