If you're concerned about safety, driving aids like drowsiness/attention warnings, lane keeping assist, automatic emergency braking, etc are the way to make things a bit safer. In combination with the continuing march on collision safety for when they do happen.

If you're concerned about the costs of a driver, I grant that the marginal costs per hour of driving is low, but the material costs seem high, unless a significant cost breakthrough is found in lidar production, or a technique breakthrough using multiple cameras; and the R&D costs seem pretty enormous -- people have been seriously working on this since the 80s and it's clearly closer than fusion, but it seems perenially 15 years away.