Re:Waymo gets green light in California to pick up passenger...
by amelius on Thursday July 04, 2019 @05:50AM
(#20353079)
Yes, and I think we should protect users from automatic updates.
An AV company should only be able to update the car software after that software has correctly driven for X million miles.
Perhaps a separate agency should perform the actual updating (installing of the new software), so we can be certain that no "quick fixes" are happening behind the scenes.
If we set up the goalposts fairly, Waymo wouldn't be anywhere near receiving permissions for full autonomy until we had statistically significant evidence the latest build could reduce fatalities to human levels which are in the region of 1 per 100 million miles (a rate which includes all the people who aren't allowed on the road...). When they've only driven a few million miles, the fatal error rate - including potentially fatal collisions avoided by safety drivers - really should be zero.
We haven't got any evidence that fatal errors in AV technology approaches that level of rarity, will never have it for individual builds, and the best [limited] evidence we've got refuses to reject the null that despite being shielded from hard AI problems like left turns and supported by safety drivers and driven at low speeds, AVs are an order of magnitude more deathly than human-driven cars...