Re:Tesla FSD Timeline
by xendipity on Wednesday December 13, 2023 @06:46AM
(#38625920)
A YouTuber named DirtyTesla has done a series of drives over the years throughout his hometown where he's tracked the intervention and disengagement rates per mile. He often shows those numbers at the end of his videos.
[ Parent
| on HN ]
Is it the same route every time?
If not, they might take harder and harder routes as FSD gets better. Making it look like there is less progress than there really is.
You just know that Tesla would tune the software for this specific route, if the value of the comparison number became meaningful.
Just like you cannot trust benchmarks, Goodhart's law will kick in https://en.wikipedia.org/wiki/Goodhart%27s_law
> Any observed statistical regularity will tend to collapse once pressure is placed upon it for control purposes
Re:Tesla FSD Timeline
by mensetmanusman on Wednesday December 13, 2023 @08:48AM
(#38627279)
Their model architecture don't allow for individual route tuning.
I think that is not true. They can just take data from the route, annotate it and put it into their training set. That is how you would do route tuning.
Sort of off-topic but I believe Openpilot allows this. You can record every route you take, copy it off to your PC and run it in a simulator. You can then tweak the model for this particular issue.
Re:Tesla FSD Timeline
by tsimionescu on Wednesday December 13, 2023 @09:00AM
(#38627442)
They claim.