News for hackers. Stuff that matters.

A comment on Drivers react to Tesla’s full self-driving beta release. Parent comment

Re:Drivers react to Tesla’s full self-driving beta release by 6gvONxR4sf7o on Saturday October 31, 2020 @02:54PM (#24954189)
That's not as useful as it might sound. If a particular action the driver didn't take would lead to results that didn't happen, then shadow mode will have a lot of trouble knowing that. In general it's a problem called "off policy evaluation" and it's really hard. Tesla has to estimate what would have happened counterfactually, had the bot been driving, instead of seeing what happens with the bot driving. A million miles of this shadow mode evaluation isn't worth nearly as many miles of actual self driving.
[ Parent | on HN ]
Re:Drivers react to Tesla’s full self-driving beta release by optimiz3 on Saturday October 31, 2020 @03:24PM (#24954423)
> If a particular action the driver didn't take would lead to results that didn't happen

I'm having a hard time parsing your double-negative, but when shadow mode is running, it's choices are back-tested in real-time with the driver's choices, so I'm not sure how this fails to replicate what a real-driver would have done in such scenarios.

[ Parent | on HN ]
Re:Drivers react to Tesla’s full self-driving beta release by egsmi on Saturday October 31, 2020 @03:29PM (#24954452)
Here an example. I’m on the freeway in my Tesla and instead of staying behind a car, at a safe following distance as predicted, I change lanes and speed past. Was it because, 1) the car was doing something I perceived as dangerous and I moved to a safer position, 2) I’m in a freaking Tesla and I can
[ Parent | on HN ]
Re:Drivers react to Tesla’s full self-driving beta release by matthewdgreen on Saturday October 31, 2020 @04:40PM (#24955032)
Tesla's shadow mode is collecting real data up until the point where the car's decisionmaking process and the human driver disagree. Everything after that is simulated fantasy. And since human drivers aren't necessarily going to do "the right thing" in all circumstances (there isn't necessarily a single 'right thing') you can't treat 'car-disagrees-with-human' as an error case.
[ Parent | on HN ]
Re:Drivers react to Tesla’s full self-driving beta release by snovv_crash on Saturday October 31, 2020 @05:21PM (#24955291)
Other cars respond to your actions, so the moment your actions deviate from the bot the reactions of the other cars are no longer valid to test against.
[ Parent | on HN ]
Re:Drivers react to Tesla’s full self-driving beta release by 6gvONxR4sf7o on Saturday October 31, 2020 @10:03PM (#24956727)
Backtesting a driving model, it’s very hard to tell what would have happened, had the car deviated at all from what the driver did.

e.g. You see the driver swerve for no apparent reason, did the driver simply drive more recklessly than the car would, or did they avoid an obstacle the model didn’t catch?

[ Parent | on HN ]