Everyone else performs a tradeoff along multiple axes including price, convenience and safety. Not needing a driver, freeing up time and lowering prices increase utility which could even justify a slight increase in risk. But even if we don't want to increase risk then a self-driving system still only has to be as good as humans on average to result in no net-increase of deaths per passenger mile while still increasing overall utility.
And more simply, it is silly to expect the maximum possible value to be the minimum requirement.
If the software is in active control pretty much everything that goes into that is different from software that is deciding if and when to emergency brake.
To put it another way, a self-driving system will become safer than human drivers, not because it knows how/when to emergency brake really well, but because it won’t have to emergency brake as frequently as a human does.