It is a valid point but the financial incentives are so big that some jurisdictions will allow it. In fact they already do allow these autonomous systems on public roads. That is going to continue to expand and since the financial incentives are huge even when deaths happen the governments will continue to allow it.

And in fact some regulators fully understand the tradeoffs and will prefer autonomy for the better good of the public. An example of this is the Boeing 737 Max, those crashes wouldn't have happened if there were no autopilot systems. But regulators are not suggesting that all autonomous systems on planes be turned off because of the safety and financial advantages of keeping them in place even though they are obviously not perfect.