baseline in this case means minimum to be considered acceptable. We have been allowing humans to drive vehicles for as long as there have been vehicles.
Why would we not use that as the baseline? Do autonomous vehicles need to be absolutely perfect before they're allowed on our roads? or just be as good as humans, with the possibility of being better?
Otherwise "it's better than humans" is in fact a win.
When I had Hodgkins, I found out there is no baseline data for untreated patients. Scientific medicine was invented after the first cures for Hodgkins, so by the time anybody knew "We should measure properly what happens if you do nothing so we know whether we're improving on that outcome" it would be unethical because you're giving people a death sentence in order to do science, which, you know, we outlawed that because of the Nazis.
We can assume not treating Hodgkins is extremely bad but we don't have scientific data, because all the untreated people in a civilised country self-selected - they said "No" having been told that means they'll almost certainly die, and right soon if they say "No". That's not a normal sample, that's... crazy people maybe? Very religious people? Not normal. But we don't have actual baseline numbers.
However, although we don't have a baseline, we do run trials, they compare against what we're currently doing, called the Gold Standard, in my case ABVD. When I was treated, trials were investigating Stanford V, the fifth attempt by a team at Stanford to improve on the existing treatment regime. It was similarly effective at curing Hodgkins, but the side effects were, if anything, worse, so, no dice.
For cars that "Gold Standard" in the US is basically every adult except the very poor and the blind. If an AI can do better than the Gold Standard, even if it's not as good as you'd like, it's an improvement.
Indeed and the most individual form of transport is walking and most cities in the world are built around walking. Only the US lays its cities out to require cars. It never really laid its cities for horses and carts (with the exception of Salt Lake City.) Before the car, cities were being built around the streetcar, and before that around walking. It's not like people lived in suburbs and went around in horse and buggy lol.
I don't know where this comes from, other than the usual "US bad". Go to Johannesburg and live in a regular estate without a car.
I'm not familiar with South Africa, but Australia also copied a lot of US auto-centric code regulations, so have no doubt that they did as well. But they very much aren't the norm. Most of Asia (outside of Middle Eastern cities and even here it's a mixed bag with Oman being different than the rest) and Europe are built around pedestrians.
If you think I'm just angry at the US due to some internet lefty baggage, then I don't know what to say. Japan shows that cars and pedestrians can coexist fine when you don't cater to just the car.
Also relevant is when Anthony Levandowski at Google / Waymo caused a freeway incident through unsafe testing: https://www.businessinsider.com/anthony-levandowski-google-s...
While at the time the DMV did not require reporting, later when Levandowski was on trial Google / Waymo hid the video of the incident when it’s existence was finally reported on.
Imagine driving by a playground and, instead of a dog, you see a ball roll across the street in front of your car, but you can already intuit that it is rolling fast enough that it won't be an obstacle in your lane. A human driver can intuit from the context (playground + ball) there is a chance a child may come running after that ball, from between those same cars.
While self-driving tech may be faster at 'seeing and classifying'* objects, is it able to predict from a larger context? I haven't seen much to indicate it can. I think that's where a lot of the edge cases are going to come from. Driving is more than just 'see object and make a decision'.
*Because most of the tech is relatively opaque to the public, this performance seems to be generally taken on faith. But what the Uber accident in AZ showed is that (with that system, at that time, at least) the self-driving tech really wasn't very good at classification in real-time.