If not, they might take harder and harder routes as FSD gets better. Making it look like there is less progress than there really is.
Just like you cannot trust benchmarks, Goodhart's law will kick in https://en.wikipedia.org/wiki/Goodhart%27s_law
> Any observed statistical regularity will tend to collapse once pressure is placed upon it for control purposes
Tesla keeps the true data secret and cherry pick the results they want. Would be inserting to data mine that data, like
- are there roads where humans always (most of the time ) take over
- how many near accidents are caused by FSD/autopilot
- are there time of day variations
- are there weather variations
- are there issues after software updates
- what are the good roads and bad roads see if we can identify what is special about them.
Probably there could be more the public would like to know if the data would be made public, and IMO makes no sense to keep this public safety data secret.
That would give a nice chart over time from which one could see the progress.
Is there anything online similar to this?
Another way to look at it would be to look at the revenue that is generated via FSD. Buyers probably do some due dilligence what FSD offers. If the number of buyers goes up, that could be an indicator that FSD is getting better. But a quick Google search did not bring up much data about this published by Tesla. In their earnings report, there is a chart showing the cumulative miles driven with FSD. Not sure if one can draw conclusions from that. It seems very smoothed out and only goes back to 2021.