News for hackers. Stuff that matters.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by brianwawok on Wednesday April 26, 2023 @10:09AM (#35713899)
So that's a good hunch. Where is the data showing that Tesla software is causing more crashes than say people driving base? Without data, why are you thinking that something should be not allowed on the roads? Opinions without data are just that.. opinions. Would be a pretty terrible way to regulate.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by NhanH on Wednesday April 26, 2023 @10:14AM (#35713988)
Wait what? Tesla should be the one providing the data showing that it is safe for their software to be on the road, not the other way round. Vehicles have always need to be regulated to be on the road, rather than retroactive ban after they kill a bunch of people.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by ChrisMarshallNY on Wednesday April 26, 2023 @10:24AM (#35714131)
> rather than retroactive ban after they kill a bunch of people.

I grew up in the US, in the 1970s-80s, when we had [optional] seatbelts, that would cut you in half, and snap your spine, exploding [leaded] gas tanks, glass that would slice you to ribbons, and steering wheels that would impale the drivers.

It's always been retroactive. Ralph Nader made his name on Unsafe at Any Speed[0].

Money speaks very loudly in the US, and we have always been willing to sacrifice quite a few things (as long as the non-money-makers are making the sacrifices), and take huge risks (as long as the non-money-makers are taking the risks), for money. It's just the way we are.

[0] https://en.wikipedia.org/wiki/Unsafe_at_Any_Speed

Re:Tesla Again Paints a Misleading Story with Their Crash Data by jjoonathan on Wednesday April 26, 2023 @10:52AM (#35714576)
The problems with this policy are obvious, but it brings benefits too: we are allowed to develop new technology. If self driving has to be rigorously proven before it can be tested, the chicken-egg problem simply resolves itself into "the tech won't be developed here." Is that really what HN wants?
Re:Tesla Again Paints a Misleading Story with Their Crash Data by kibwen on Wednesday April 26, 2023 @11:04AM (#35714806)
As a pedestrian and cyclist, what I want is to not become a statistic in a crash report. We can develop new things and test them under controlled conditions without having to put everyone outside the car at risk.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by jjoonathan on Wednesday April 26, 2023 @11:14AM (#35714991)
AI is easily our best bet against the true menace, which is distracted drivers.

No, "controlled conditions" don't do a very good job of training or proving an AI. Supervised cars on actual roads is the way it has to be.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by acdha on Wednesday April 26, 2023 @11:46AM (#35715614)
Speed limiters and automatic braking get most of the benefits without any need for hard AI problems. What AI promises is a way for governments not to have to take the heat for holding drivers accountable, but hundreds of thousands of people are being killed waiting for it to materialize.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by piva00 on Thursday April 27, 2023 @04:53AM (#35725155)
The best bet against the true menace is to deploy public policies that reduces the true menace: the number of cars/drivers on the streets.

That's the most sound policy, provide the public with alternative means of transportation that are convenient and more environment-friendly, leave room on the streets for the ones that actually require a car for their transportation. If you leave in the middle of bumfuck nowhere and can't be served by public transportation, great, you probably need a car. If you drive your car in cities for trips of 5-10km because it's convenient then we, as a society, should find ways to disincentivise this usage.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by anotherhue on Wednesday April 26, 2023 @12:17PM (#35716152)
https://youtu.be/fPF4fBGNK0U

Modern car crash test into older car.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by ChrisMarshallNY on Wednesday April 26, 2023 @01:14PM (#35717024)
Looks like the Malibu driver gets out, and cusses out the splattered remains of the Belair driver, who is removed from his car, with a teaspoon and a sponge.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by ajross on Wednesday April 26, 2023 @12:30PM (#35716321)
> Tesla should be the one providing the data showing that it is safe for their software to be on the road

The linked article is literally about the data Tesla provides showing that their vehicles are safe, and it doesn't even refute the conclusions. It's about nitpicking at the margins.

To be clear: Tesla's data says autopilot use is about an order of magnitude safer than human driving. The author complains that this is confounded by the fact that AP is used in different conditions where the baseline accident rate is lower.

You need a lot of confounding effect to make up for an order of magnitude delta! Seems like everyone wants to skip that part and yell about the CEO instead.

The cars are safe. They are extremely common vehicles now. If they were unsafe we would know. We know they are safe. Any argument needs to treat with this truth, or it's basically just a conspiracy theory.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by ra7 on Wednesday April 26, 2023 @12:42PM (#35716529)
> It's about nitpicking at the margins.

The article is not nitpicking at the margins. It's showing how Tesla is making misleading claims out of their insufficient data by not accounting for operating conditions. That's literally how Tesla is claiming Autopilot is "an order of magnitude safer than human driving".

> You need a lot of confounding effect to make up for an order of magnitude delta!

Or you could just make misleading comparisons to claim that. That's pretty easy too.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by ajross on Wednesday April 26, 2023 @12:54PM (#35716713)
It's just tiresome. You know the cars are safe. You want to say they're unsafe. But you can't, because they're safe. So you're yelling about what amounts to marketing strategy.

Which, fine. Everyone does bad marketing, there's lots to yell about. Maybe consider yelling about the deceptive marketing practices of a product you do use? There are lots to choose from.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by ra7 on Wednesday April 26, 2023 @12:58PM (#35716781)
"Our cars are safe"

"Show us unbiased data proving it"

"If it were unsafe, we would know"

Sigh.

I own a Tesla and use FSD, but thanks for assuming.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by ajross on Wednesday April 26, 2023 @01:30PM (#35717261)
They did show the data. You want to throw the data out instead of believing it. Nitpicks aren't winning arguments, and you know that. I'm saying that if you want to argue with someone's data, you need to argue with data and not just that some different experiment would be better.

What the linked article is doing is just excuse-making, basically.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by ra7 on Wednesday April 26, 2023 @01:37PM (#35717358)
Huh, what? It's completely reasonable to question the methodology. That's not nitpicking.

I get it. You want to take the data at face value without questioning anything.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by ajross on Wednesday April 26, 2023 @04:42PM (#35719704)
To be blunt: I don't take your words here to be a dispassionate "questioning of methodology". If that was your goal, you would at least nod to the numbers and the clear fact that even if the measurements were confounded they probably point to a safe system.

I'm not saying take it at face value at all. I'm happy to discuss methodology and to admit that the numbers on Tesla's site amount to something closer to marketing than science. But nonetheless, the cars remain safe. This methodology would have to be outrageously confounded to produce a result like this for an unsafe car, and you know it.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by clouddrover on Wednesday April 26, 2023 @08:04PM (#35721585)
> The linked article is literally about

Dude, you couldn't even get the date of the article right.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by MBCook on Wednesday April 26, 2023 @10:21AM (#35714080)
Only Tesla has that data, so no one can link to it.

If it showed things were better than average it would fit their message and I’d expect them to publish it.

If it showed things were average it would not fit their narrative. If it showed things were worse it would contradict their narrative.

Seems like there is only one reason to withhold numbers or publish them in a misleading way. They prove your claims that your tech is way safer wrong in some way.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by jjoonathan on Wednesday April 26, 2023 @10:32AM (#35714230)
Tesla has said they intend to pick the "better than human" fight at 5 billion miles, when they believe their advantage will be decisive rather than having an outcome that depends on how you count.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by netsharc on Wednesday April 26, 2023 @10:53AM (#35714580)
So... until they reach that number, they'll publish misleading stats (i.e. outcomes that favor them depending on how they count)?
Re:Tesla Again Paints a Misleading Story with Their Crash Data by hansvm on Wednesday April 26, 2023 @10:53AM (#35714589)
Even then there'll be a distribution shift effect they need to account for. Not everyone is allowed into the FSD program, and the fact that they're self-selecting to use FSD additionally biases the roads and conditions where they choose to do so. Moreover, how you count is still very relevant if all the hairy events happen when a human operator takes control -- the car screwed up, but the resulting crash gets blamed on the operator who couldn't react to the ensuing shitshow in time, and even if total crashes/fatalities are lower when counting those events you still have the self-selection problem of perhaps those FSD operators in those conditions being better at recovery from car-induced errors than the general population in arbitrary conditions would be.

Like...maybe it's fine. But even at 0 fatal crashes in 5 billion miles they won't have a strong argument that a more widely deployed FSD would have similar success without a lot more data to explain how the thing they measured directly connects to the thing they'll want to claim it represents.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by jjoonathan on Wednesday April 26, 2023 @11:01AM (#35714734)
Thank you for demonstrating my point. This is exactly why they want a safety margin on their safety margin.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by rurp on Wednesday April 26, 2023 @11:42AM (#35715535)
Then Tesla should stop making claims about safety until they are willing to back them up with evidence. The most likely scenario given the available information is that Musk is lying and Tesla's aren't as safe as the company would have us believe.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by jjoonathan on Wednesday April 26, 2023 @12:34PM (#35716401)
Tesla's claims from TFA are pretty cringe, but so are the calls to ban FSD on account of a horrible safety record that isn't actually horrible.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by MBCook on Wednesday April 26, 2023 @12:50PM (#35716649)
> account of a horrible safety record that isn't actually horrible.

That’s the problem. We don’t know the safety record because Tesla won’t release it.

But the anecdotal evidence we do have is very worrying. And the development model doesn’t inspire confidence.

So the calls to ban it seem very reasonable to me.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by gizmo on Wednesday April 26, 2023 @10:56AM (#35714643)
Okay so Musk loudly proclaims that buying a Tesla is the best financial investment on the planet, that buying anything else is pure insanity, on the basis of the car turning into a fully autonomous taxi via a future over the air update. Bold claim, no data provided.

Musk boasts that Teslas have the highest crash safety ratings ever, despite this being contradicted by the testing bodies (because they don't distinguish between cars with 5 star ratings). Another bold claim, contradicted by the data!

Teslas collect tons of data while driving and when crashing, which Tesla processes. You believe that this data demonstrates that FSD is safer than regular driving but that musk is too cautious to release it?? How can you square that with Musk's behavior generally?

Re:Tesla Again Paints a Misleading Story with Their Crash Data by jjoonathan on Wednesday April 26, 2023 @11:09AM (#35714874)
Musk is a bloviating idiot. As for FSD, I believe that FSD is better than a bad driver and that with supervision by a responsible driver it's fine to allow on the roads.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by MBCook on Wednesday April 26, 2023 @11:04AM (#35714800)
And yet “it’s safer than normal drivers” is the defense people have been using to defend AP/FSD for years.

But we don’t know that because Tesla won’t tell us.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by jjoonathan on Wednesday April 26, 2023 @10:22AM (#35714101)
Yes, and we have to mind the denominator too. Waymo just announced 1 million self driving miles, Tesla just announced 150 million self driving miles.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by ra7 on Wednesday April 26, 2023 @10:38AM (#35714319)
Waymo self driving is not at all the same as Tesla’s. One is fully driverless and the other requires driver monitoring.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by jjoonathan on Wednesday April 26, 2023 @10:50AM (#35714532)
Yes, but Tesla does have a driver monitoring, so that's the relevant safety number.

Nobody, even Tesla, is currently arguing that Tesla FSD is ready for driverless.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by tasty_freeze on Wednesday April 26, 2023 @10:59AM (#35714702)
You just pointed out that the two driving assists are apples and oranges ... yet it was you who compared Waymo's driverless car total mileage vs Tesla's FSD.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by jjoonathan on Wednesday April 26, 2023 @11:21AM (#35715123)
We are talking about safety and risk, not dick measuring the tech stack. Tesla has 150x the miles, which means that for the same risk level they should see 150x the problems. Maybe divide that by 3 to account for highway vs around town. I don't see 50x the number of "Tesla killed my dog" stories as "Waymo killed my dog" stories, so Tesla probably isn't taking egregious risks. What's your heuristic?
Re:Tesla Again Paints a Misleading Story with Their Crash Data by simondotau on Wednesday April 26, 2023 @10:14PM (#35722513)
This is correct but misleading. Waymo and Tesla are pursuing strategies so different that attempting to compare them is futile.

It's true that within the small geofences in which Waymo operates, their cars are dramatically less likely to come unstuck than a Tesla running FSD beta. On the other hand FSD beta drives on pretty much any public road and not a curated set of pre-driven, pre-mapped, pre-validated streets. Yes there are many geographies where it struggles; there's a cottage industry of people obsessively showing these on YouTube. There are also some areas of the country where FSD beta is utterly rock solid and people routinely drive substantial distances with zero interventions.

It's also not entirely accurate to describe Waymo cars as "fully driverless" as they have a team of human employees remotely monitoring the fleet and can remotely operate any vehicle.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by ra7 on Wednesday April 26, 2023 @10:23PM (#35722575)
> It's also not entirely accurate to describe Waymo cars as "fully driverless" as they have a team of human employees remotely monitoring the fleet and can remotely operate any vehicle.

This is absolutely not true. Waymo remote agents cannot operate a vehicle. All they can do is answer questions from the vehicle or plot a path to go around if it gets stuck. They cannot make any safety critical interventions. Waymo has talked about this many times.

It’s fully driverless because the vehicle is responsible for attaining minimal risk condition all on its own. This is how other L4 companies like Cruise works too.

Zoox has a good explanation on how their teleguidance works: https://youtube.com/watch?v=NKQHuutVx78

Re:Tesla Again Paints a Misleading Story with Their Crash Data by simondotau on Thursday April 27, 2023 @05:37AM (#35725542)
“Plot a path to go” is literally what it means to control the vehicle remotely.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by ra7 on Thursday April 27, 2023 @08:37AM (#35727109)
Nope, that’s misleading. Still no “control” over the vehicle because the vehicle is executing the move. It’s assisting the vehicle. They don’t have the ability to joystick the car.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by simondotau on Thursday April 27, 2023 @10:31AM (#35728705)
Your point is that the Waymo operator isn't really in control because the vehicle can ignore instructions; the on-board computer won't allow the remote operator's instructions to result in a collision. If I attempt to drive my own car into a brick wall, the on-board computer will defy my instructions as best it can too. By your definition, I'm not in control of my car just like Waymo operators aren't.

Fact is, a Waymo operator can take enough control of the vehicle to be considered in control of it. It doesn't matter if control comes in the form of a steering wheel or a joystick or drawing vectors on a map. Control is control, whether it's direct, indirect, or funnelled through a governor. Waymo operators can intervene and direct the car as needed.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by ra7 on Thursday April 27, 2023 @10:40AM (#35728855)
> If I attempt to drive my own car into a brick wall, the on-board computer will defy my instructions as best it can too. By your definition, I'm not in control of my car just like Waymo operators aren't.

Terrible analogy. You are sitting in the driver's seat with your hands on the wheel. If your car is about to hit someone, you can prevent it because you are the driver. This is what FSD is — ultimately driver is in control. No such luxury for Waymo/Cruise as their remote operators cannot do any safety critical interventions like preventing crashes.

All they can do is non-safety critical interventions by way of passing indirect commands. A Waymo is in control of itself at all times and is fully responsible for its own safety. You can play with words like "control" all you want, but this is the definition of SAE Level 4 autonomy.

If anything, calling FSD "autonomous" is highly misleading because drivers are preventing mistakes and thereby hiding its real safety outcome.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by simondotau on Thursday April 27, 2023 @09:46PM (#35736650)
> Terrible analogy.

I agree, it's a terrible analogy if I was attempting to make the argument you thought I was trying to make, per your explanation for why it's a terrible analogy.

My point is that it's invalid to say that Waymo operators don't have "control" of the vehicle because it can refuse to perform some tasks. Because my car can refuse to perform some tasks too.

The deeper point is that the difference between "in control" and "not in control" isn't binary. It's all points along a continuum. If a Waymo operator controls a vehicle remotely, it's not the same level of control as a human holding the steering wheel. But it's still control in the larger sense. If the operator wants the car to stop, it will stop. Period. If they want the car to perform some action that isn't stupid or dangerous (such as colliding with a pedestrian) it will perform that action.

> If anything, calling FSD "autonomous" is highly misleading

I agree. Which is why I didn't. In most situations FSD beta can handle the "full" task of driving. By "full", they mean it's not intended to be limited to a strict subset of task, e.g. only on highways. It can "fully self drive" the car competently at least ~99.9% of the time, as evidenced by the fact that it can routinely drive most roads reliably. Drives shown on YouTube are mostly owners intentionally looking for roads which flummox it, as that's how they show improvements as software updates are released.

The challenges which preclude FSD from being a system capable of autonomy — the 0.1% of remaining error — isn't errors in spatial awareness or control surface failure. It's stuff like path planning and road sign interpretation, neither of which involve sensors that Tesla vehicles lack.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by tsimionescu on Wednesday April 26, 2023 @10:53AM (#35714600)
Tesla has 0 self-driving miles, since a driver is always there and is fully responsible for any mistake that happens.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by lern_too_spel on Wednesday April 26, 2023 @12:01PM (#35715881)
Waymo had 20 million self driving miles on public roads in 2021. Earlier this year, Waymo announced 1 million self driving miles on public roads with nobody in the driver's seat. Tesla has 0 such miles.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by jjoonathan on Wednesday April 26, 2023 @12:39PM (#35716478)
Thanks for clarifying! So Tesla has 7x the miles and so if their test program is riskier we should expect to see >7x the number of accidents.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by lern_too_spel on Wednesday April 26, 2023 @04:11PM (#35719319)
We see far more than 7x at fault accidents. As far as I know, Waymo has had none. Tesla has had so many that it had to post a recall notice.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by bradtemp on Thursday April 27, 2023 @12:18AM (#35723246)
No because when Tesla's system has a problem, as my car does a few times each trip, I grab the wheel. And waymo also has cars with safety drivers but also has run a million miles without one. Run Tesla FSD with no intervention for a million miles and it would have thousands of accidents. Thousands, where it was at fault. Waymo had 2 or 3 minor parking lot style no damage contacts in their million. Not thousands
Re:Tesla Again Paints a Misleading Story with Their Crash Data by kaba0 on Wednesday April 26, 2023 @12:58PM (#35716786)
On motorways mostly, where the problem is almost trivial. If you add to it that it is much easier to accumulate miles there, Waymo’s number is much more impressive.

It’s a bit like stress testing two frameworks, one tested only for a day, but at the frontpage of HN, while the other was up for a months, with barely any clicks.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by jackmott42 on Wednesday April 26, 2023 @10:17AM (#35714032)
Many people take the view that you shouldn't introduce a radical change in how cars work until it is proven safe, rather than feeling it should be allowed on public roads until it is proven unsafe.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by try_the_bass on Wednesday April 26, 2023 @10:53AM (#35714595)
It seems like it's impossible to prove that it's safe on public roads without actually using it on public roads, though? Wouldn't that be an impossible ask, by definition?
Re:Tesla Again Paints a Misleading Story with Their Crash Data by cptcobalt on Wednesday April 26, 2023 @11:10AM (#35714901)
Exactly. There's no better facsimilie for the sheer variety of public roads than, well, public roads. Tesla even has rigorous simulation in place for hostile situations that should never occur on public roads:

A good general overview from two minute papers: https://www.youtube.com/watch?v=6hkiTejoyms Tesla's AI Day 2022 video, timestamped around labeling and simulation https://youtu.be/ODSJsviD_SU?t=6037

Re:Tesla Again Paints a Misleading Story with Their Crash Data by kibwen on Wednesday April 26, 2023 @11:09AM (#35714893)
It is entirely possible to test things under controlled trials to simulate real-world conditions. To use an analogy, we don't just test new medicines by putting them on the shelves and waiting for consumers to report side effects. We have strenuous trials first to give us baseline confidence in the product.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by try_the_bass on Wednesday April 26, 2023 @04:02PM (#35719203)
I would argue that it's impossible to simulate real-world conditions for a task as complex as driving. There are too many edge cases and different combinations of environmental factors, many of which involve the inherent unpredictability of other drivers.

I would assume medicines have similar or higher levels of complexity involved. However, the medicine analogy is poor. We often release medicines for use even when they have incredibly harmful side-effects. We do the testing to quantify and understand those side-effects, not prove that each medicine does exactly what it should with no side effects.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by kaba0 on Wednesday April 26, 2023 @12:54PM (#35716717)
I still see no reason why should a private company be allowed to risk the lives of those who never willingly participated in their study.

There are human trials for drugs as well, but those are only the latest phase, and with explicit permission.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by try_the_bass on Wednesday April 26, 2023 @03:50PM (#35719018)
Isn't the usage of Autopilot "willing participation"? Or are you referring to the other people on the road?

Wouldn't that also be true of your medicine analogy? If someone takes an experimental medicine but experiences an unknown side effect and passes out while driving, isn't the risk profile equivalent?

That hypothetical certainly is far less probable than the Autopilot case, but for any experiment that takes place outside controlled conditions, there can always be unknown and unforeseen consequences that affect people who have not given explicit consent to being part of said experiment.

To argue that we cannot test things unless all potentially-involved parties have given consent is to argue for an impossibility. There is always some small amount of risk of higher-order consequences.

I would even go further and say that arguing for such is an unnecessarily conservative approach that hamstrings any attempt at improving the world. See, for example, this commentary on the current state of IRBs [1]

[1] https://astralcodexten.substack.com/p/book-review-from-overs...

Re:Tesla Again Paints a Misleading Story with Their Crash Data by kaba0 on Wednesday April 26, 2023 @06:23PM (#35720815)
There are plenty of drugs after which you can’t drive.

Also, the “danger to others” aspect is even then negligible as opposed to some faulty software controlling a ton of steel/battery in a system that depends heavily on predictable behavior of each other.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by try_the_bass on Saturday April 29, 2023 @06:28PM (#35757877)
Safe driving for a human also depends heavily on predictable behavior of others. If that's an important metric, it seems like the optimal solution is a single self-driving system with a monopoly on the market... that way each and every driver is predictable, correct?

I guess I don't understand your argument. We put faulty humans in control of a ton of steel/battery in the same system all the time; humans have the disadvantage that when lessons are learned, they aren't transferrable without great amounts of effort. Self-driving systems can share learnings across the whole fleet with software updates, which seems like a strictly better solution in the long term.

It seems like you're making perfect the enemy of "better".

Re:Tesla Again Paints a Misleading Story with Their Crash Data by UncleEntity on Wednesday April 26, 2023 @11:50AM (#35715686)
There’s a slight difference between alpha/beta testing software on public roads and and something like… IDK, can’t think of anything even comparable that’s happened in my lifetime, anti-lock brakes maybe? Which, incidentally, fail safe and don’t happily run into stationary objects on a regular basis.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by simondotau on Wednesday April 26, 2023 @10:29AM (#35714187)
It’s rather telling that the reply saying “show me evidence” is being voted down while the assertions mixed with disdain for Musk are being voted up.

Look, I get that Musk isn’t popular here. But please, give me some hope for humanity and at least pretend to care about facts and evidence.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by jackmott42 on Wednesday April 26, 2023 @10:30AM (#35714205)
Our point of view is that we should not allow beta self driving software on the roads until it is proven safe. We do not know how safe it is, nor can we know because Tesla controls that data and is not transparent with it.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by simondotau on Wednesday April 26, 2023 @10:41AM (#35714391)
Should we allow teenagers to drive on the road before they have proven to be safe? We don’t know how safe they are.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by jackmott42 on Wednesday April 26, 2023 @10:45AM (#35714470)
No, we should require that they pass a driving test, pay for insurance, and register their vehicle with license plates. If I were emperor I would raise the driving age to 18 as well.

vote often, vote early

Re:Tesla Again Paints a Misleading Story with Their Crash Data by simondotau on Wednesday April 26, 2023 @10:54AM (#35714603)
A person who was passed a driving test, paid for insurance and registered the vehicle is responsible for the car at all times, even when FSD beta is operating.

Come to Australia, the driving age here is 18. (And for your first three years as a licensed driver, you have to show plates to indicate your lack of experience because, unlike in the stupid USA, we don’t assume that passing one driving test is enough to qualify you as a “good driver”.)

Re:Tesla Again Paints a Misleading Story with Their Crash Data by tsimionescu on Wednesday April 26, 2023 @10:55AM (#35714626)
No, and we don't. That's why driving instruction and driving tests exist.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by simondotau on Wednesday April 26, 2023 @10:58AM (#35714688)
Thirty thousand people die on US roads every year because of the actions of people who received driving instruction and passed a driving test.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by rootusrootus on Wednesday April 26, 2023 @11:14AM (#35714974)
This is a better argument for improving training and testing than it is in lowering the bar and letting a buggy computer program drive.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by jjoonathan on Wednesday April 26, 2023 @11:49AM (#35715668)
Do you really think there's more room to improve human nature than AI technology? I don't.

I think they both have a ceiling and that the ceiling on AI is much higher.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by rootusrootus on Wednesday April 26, 2023 @11:53AM (#35715760)
Yes? The largest causes of accidents are fairly well understood, if we decided it were worth the effort. Not coincidentally, this is why all the arguments for self-driving fall flat. Being as good as an average driver is a low bar. Being as good as a median driver is a harder task. But it's the latter that is the bar we have to pass if self-driving cars are ever to become mainstream.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by jjoonathan on Wednesday April 26, 2023 @12:16PM (#35716124)
Deaths = N*average, not N*median.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by rootusrootus on Wednesday April 26, 2023 @01:44PM (#35717452)
I was not trying to claim otherwise. But unless you are intending to make self-driving cars mandatory, N*average is meaningless. The median driver is who you actually need to convince, and they are not going to choose a self-driving car that is less safe than they are.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by simondotau on Wednesday April 26, 2023 @09:42PM (#35722236)
It was only intended as an argument as a direct response to the post by tsimionescu. Tesla could focus on making FSD beta satisfy the driver test given to teenagers. It could perform the test as well as any 16-year-old and we'd all agree that it wouldn't really prove anything about the safety of FSD or the human teenager.

Which is my point — the road is full of hideously bad/dangerously inexperienced human drivers holding driver licenses. Given this, it's hard for me to interpret the pearl-clutching around humans co-driving with FSD beta as anything other than confected paranoia.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by kibwen on Wednesday April 26, 2023 @11:11AM (#35714926)
And ubiquitous FSD could easily make that number worse, not better.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by kaba0 on Wednesday April 26, 2023 @01:07PM (#35716932)
Many (most?) accidents are due to a clearly in the wrong driver (drunk-driving, texting, etc), and the other parties have no way of avoiding that. How exactly would a few self-driving cars help here? They can’t prevent a collision when the other party goes over a red light at some insane speed. They could start breaking sooner, which is great, but that doesn’t need self driving, it is a feature of plenty of cars already.

Of course if every car would be self driving we wouldn’t have crazy drivers, and accidents would diminish, but so would if we simply didn’t have crazy drivers. Neither is feasible in the near future, and in the short term, humans are much better at handling tricky situations (like.. not emergency braking at the sight of a plastic bag in the air)

Re:Tesla Again Paints a Misleading Story with Their Crash Data by hnburnsy on Wednesday April 26, 2023 @10:57PM (#35722794)
I'd bet that Tesla FSD could pass most DMV driving tests in the US.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by ndsipa_pomu on Thursday April 27, 2023 @04:39AM (#35725026)
That'd be really interesting to see how well it does.

I wonder why there's no modified version of driving tests for AVs that each software iteration takes.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by slg on Wednesday April 26, 2023 @11:02AM (#35714755)
I totally understand where you are coming from. However, I don’t think it is possible to prove this type of technology is safe in the real world without lots of data of it being used in the real world. Requiring proof first like you suggest creates a catch-22 situation in which self driving technology can never be released.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by rootusrootus on Wednesday April 26, 2023 @11:13AM (#35714956)
Automakers already use proving grounds. We can set a minimum standard for FSD before turning it loose with amateur drivers.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by slg on Wednesday April 26, 2023 @11:27AM (#35715249)
You can’t test self driving tech the same way you can test most safety technology. It is easy to test something like an airbag. You throw dummies in the seats and run the car into a wall. There is no equivalent for self driving tech. The tech needs to be able to handle any weird situation that humans and nature throw at it. You therefore need a huge number or interactions, billions of miles worth, to be confident in its safety. You can’t just put a car through a test track to see if it is safe. The range of situations the technology needs to be able to respond to is too large to fully test like this.

It is a perfectly valid policy to want that proof ahead of time. I’m just pointing out that this requirement would effectively kill development of this technology for the foreseeable future.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by rootusrootus on Wednesday April 26, 2023 @11:59AM (#35715856)
Is Tesla using customer cars for training data? That should be very noticeable, it is a lot of data that would be getting fed back. If they're not, then the billions of miles driven by customers isn't relevant, and the same "can't just put a car through a test track" problem exists at the training level.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by jjoonathan on Wednesday April 26, 2023 @12:01PM (#35715887)
Yes they are, yes it is very noticeable, and yes it is a lot of very important data that could not have been collected on a test track.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by rootusrootus on Wednesday April 26, 2023 @01:47PM (#35717497)
I'd like to see something to back that claim. The amounts of data we're talking about are quite significantly more than any I've seen people experience in real life. As far as I can tell, customer cars run inference only, collect very little data unless something prompts them to (and even then, store it locally), and contribute almost zero to the training set.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by jjoonathan on Wednesday April 26, 2023 @04:30PM (#35719524)
Here's a statement from 2022. They had a labeling team of 1500 people and they laid off about 200 after the labeling infrastructure team finished an auto-labeler, so it's not just a bloated team. Do you think they are keeping 1300 people busy correcting labels on purely internal data?

https://teslamotorsclub.com/tmc/threads/tesla-lays-off-over-...

Re:Tesla Again Paints a Misleading Story with Their Crash Data by UncleEntity on Wednesday April 26, 2023 @12:09PM (#35716012)
Google’s robocars seem to be taking a very conservative approach to integration with the motoring public.

Don’t get me wrong, I irrationally hate the robots, used to see them all the time around Phoenix, was actively gunning for them and only had one time I could have rammed one[0] with it not being my fault. Which says a lot because it was (well, still is) a life goal to take out a robocar so I was really trying.

I used to see them doing a bunch of really stupid stuff but never anything that was outright dangerous, relatively speaking. One did stop in the fast lane when everyone was zipping by at 70+ because it couldn’t figure out how to merge into the left hand exit ramp but plenty of snow birds do that too so it’s not completely unheard of.

[0] (un)fortunately I was behind on my rent and couldn’t afford to spend who knows how long dealing with an accident investigation so the robot got to go about its day unmolested.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by rootusrootus on Wednesday April 26, 2023 @01:51PM (#35717540)
Google's approach is more defensible. They are careful, default to conservative behavior and stop when confused, and had professional drivers for years. And even then they're a road hazard.

At least they hold liability if anything happens, though, which is an important step.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by kaba0 on Wednesday April 26, 2023 @01:01PM (#35716830)
Also, since parts of it is a blackbox, doesn’t any update literally clears out any former result and should be revalidated from scratch?
Re:Tesla Again Paints a Misleading Story with Their Crash Data by ndsipa_pomu on Wednesday April 26, 2023 @11:51AM (#35715705)
The sensible method is for the manufacturer to perform lots of testing and make available the data. Legislators can then allow limited real world usage to determine if there's problems and then expand that usage as appropriate. e.g. allow autonomous vehicles to take control on motorways (sorry, that's a UK term - is it freeways in the U.S.?).
Re:Tesla Again Paints a Misleading Story with Their Crash Data by jjoonathan on Wednesday April 26, 2023 @12:00PM (#35715869)
That's exactly what happened. There was a back and forth with NHTSA for years before the beta started going public, and the rollout was carefully staged. At first, you needed a high safety score and it was aggressively geofenced. Those restrictions were gradually lifted as they collected data, and it still has attentiveness monitoring and a strike system. Tesla and NHTSA go back and forth on details all the time -- just recently NHTSA demanded some adjustments for stop signs and yellow lights.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by bmitc on Wednesday April 26, 2023 @10:59AM (#35714716)
> Look, I get that Musk isn’t popular here. But please, give me some hope for humanity and at least pretend to care about facts and evidence.

The onus is on Tesla to provide honest and accurate data, and they have shown time and time again that they are not capable of doing so.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by kaba0 on Wednesday April 26, 2023 @12:41PM (#35716515)
Where is the data showing that heroin is not good at curing COVID?