Re:New reports suggest limits to autonomous vehicle performance
by notatoad on Friday February 02, 2018 @01:35PM
(#16292936)
>Arguably, you could be super dishonest and handle every single intersection manually, and still have a massive miles driven statistic since most distance is accumulated on straight-ways.
i'm not sure what benefit there would be to gaming the disengagement stats. If anything, i think the incentive would be the other way around - inflate your number of disengagements so your competition thinks you're further behind than you actually are.
The point of testing is to bring a product to market, and if your product sucks people are going to figure that out relatively quickly. hiding your disengagements from the california DMV isn't going to do anything for you except build hype your product can't live up to.
Re:New reports suggest limits to autonomous vehicle performance
by analognoise on Friday February 02, 2018 @06:21PM
(#16295056)
Not if you're trying to get investment(s) or keep your stock price stable.
Re:New reports suggest limits to autonomous vehicle performance
by saltyworker on Friday February 02, 2018 @01:13PM
(#16292709)
what about hours, like a pilot?
Re:New reports suggest limits to autonomous vehicle performance
by ocdtrekkie on Friday February 02, 2018 @01:21PM
(#16292800)
Highlight point is: A pilot's hours are in almost all cases "without an incident". The problem is Google's accounting is "total miles". Distance or time isn't the problem, it's the fact that it includes "incidents" that, without a test driver, would likely be "accidents".
Re:New reports suggest limits to autonomous vehicle performance
by Zigurd on Friday February 02, 2018 @01:52PM
(#16293125)
Just like miles, which can look rather good if they are all highway miles, aircraft incidents are concentrated around takeoff and landing.
Risk also skews results: Pilots taking off and landing on beaches in Alaska aren't comparable to pilots taking off from airports on the basis of incidents per 1000 hours.
Re:New reports suggest limits to autonomous vehicle performance
by praptak on Friday February 02, 2018 @01:36PM
(#16292946)
All simple metrics can be gamed.
Re:New reports suggest limits to autonomous vehicle performance
by dredmorbius on Saturday February 03, 2018 @12:06AM
(#16296290)
s/simple//
Disengagements is a useful number, and the disengagement numbers say so much more about the real state of self-driving cars: That they fail as often as a non-synthetic oil change. And if humans had driving system failures that often, we would not be considered good at driving.
The longest number a company should be marketing is how many miles they've driven between disengagements. Like the "days since an accident" sign at a workplace: Fail, and you go back to zero. The numbers will be smaller, but they'll be a lot more meaningful.