Not a huge regulations-by-default person but I agree strongly with this. The other issue is accountability laundering. If a human kills someone they're criminally responsible. If a company's software does it then they'll shift blame onto the human passenger or deflect into a small fine, at the worst. If I can't trust the incentives then I can't trust the tech.