News for hackers. Stuff that matters.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by ndsipa_pomu on Wednesday April 26, 2023 @09:59AM (#35713743)
I keep hearing horror stories about Tesla vehicles and I'm amazed that they're allowed on public roads (in the U.S.) with what appears to be alpha-level software. I appreciate that the FSD mode is only to be used with the driver constantly monitoring and being aware, but that's an unrealistic expectation of people, not to mention a strange interpretation of "full self-driving".
Re:Tesla Again Paints a Misleading Story with Their Crash Data by drowsspa on Wednesday April 26, 2023 @10:07AM (#35713874)
Honestly, all due to the Musk influence you can "move fast and break things" even when it comes to 1-ton machines with humans inside moving at 80 miles an hour. That Tesla was allowed to test in production with basically no legal liability is so messed up
Re:Tesla Again Paints a Misleading Story with Their Crash Data by ajross on Wednesday April 26, 2023 @12:56PM (#35716755)
FWIW: Tesla is absolutely liable for any damages resulting from AP/FSD usage. They aren't protected in any way by law or regulation. You want to sue them, you go right ahead.

Normally I'd expect the fact that they aren't losing these suits regularly to factor as a prior in people's opinions about the cars' safety. But I've also been in enough of these threads to know that it's actually all about people's opinions of the CEO and not the product.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by bradtemp on Wednesday April 26, 2023 @01:18PM (#35717081)
That's not correct, they are no more liable than carmakers are if you are using cruise control.

Unless you can show in court that their system was defective. It is designed to not be able to do the full driving task, to need interventions. It performs as designed.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by ajross on Wednesday April 26, 2023 @01:29PM (#35717233)
Isn't that what I said? The logic above would work the same for cruise control. If you ship a bad cruise control or other automation system, you get sued and lose. Toyota paid out more than a billion dollars a few years back due to[1] problems with their fly-by-wire accelerator design. It's not like you can't punish an automaker for safety issues. They get sued all the time, successfully.

Except, notably, the one you want to yell about the most. I'm just saying that should maybe be part of your analysis.

Look. The cars are safe. We've been having the same argument, again and again, for years and years now. People show up in these threads just taking as a given that these systems are unsafe, and refuse to adjust that prior as these cars become some of the most popular products as a market.

[1] What were perceived as -- IIRC it's since been argued that the problem in the suit didn't actually exist. And they settled anyway!

Re:Tesla Again Paints a Misleading Story with Their Crash Data by sidibe on Wednesday April 26, 2023 @06:21PM (#35720797)
The product is ridiculous regardless of the CEO. It's at least false advertising or fraud. Looking at any video of it in action it's clearly also dangerous. It's not all about cherry picking either, on YouTube these are all big fans trying to make it seem great, but every few minutes it does something crazy.

I think the fact that it has supporters is because of the CEO, not the fact that it has detractors, though I'm sure some are more vehement because of the CEO.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by ajross on Wednesday April 26, 2023 @06:47PM (#35721000)
> The product is ridiculous regardless of the CEO.

It's amazing. The most fun I've had in a vehicle in my whole life, and absolutely worth the purchase price. I'm sorry you aren't impressed, really, and I genuinely can't understand why there's so much hate about something so great.

But none of that is relevant here. The question at hand is "is it safe?", and the clear answer is "yes, quite".

Re:Tesla Again Paints a Misleading Story with Their Crash Data by ashwagary on Wednesday April 26, 2023 @11:31PM (#35722998)
>It's amazing. The most fun I've had in a vehicle

It may be fun for you but its not fun for all the other people on the road put at risk by Tesla owners that dont know the limitations of their vehicles.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by Incipient on Thursday April 27, 2023 @02:53AM (#35724222)
I used auto steer for about 10 minutes before it got confused on a lane split and tried to crash me into a light pole =( I hope it would have stopped before hitting it, but it really didn't look like it was going to!
Re:Tesla Again Paints a Misleading Story with Their Crash Data by piva00 on Thursday April 27, 2023 @04:46AM (#35725098)
Two weeks ago I took a ride on a friend's Tesla Model S with Autopilot 2.0 here in Sweden, with the FSD feature enabled, he tried to show me how awesome it was. Driving around for 15 minutes on the highway was nice until we got into the streets inside a part of the city, not even 5 minutes in the city the car tried to steer itself into a curb during a turn, almost hitting a pedestrian waiting for the light.

No thanks, that shouldn't be allowed on public roads.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by rvz on Wednesday April 26, 2023 @10:14AM (#35713981)
There is a very good reason why people don't trust this absolute snake oil in the first place other than it being pushed by Tesla and Elon.

FSD (Fools Self Driving) feature is a complete scam with dangerous and deceptive advertising putting the lives of the driver and others at risk. The Tesla vehicles themselves are not.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by programmarchy on Wednesday April 26, 2023 @10:36AM (#35714299)
Elon is obviously doing many stupid things but there’s many smart people at Tesla working on this issue so it’s not exactly a complete scam.

Isn’t it more realistic that FSD is one of those classic engineering problems where the last 10% takes 90% of the effort?

Also, the “move fast and break things” is symptomatic of the broader tech industry. Despite being glorified for decades, it’s become a toxic mentality that’s hurt us with social media, and is now exponentially more pronounced with AI. Sure, maybe Elon should be “made an example of”, but collectively we need to sober up and realize this is a systematic issue in tech rather than scapegoating one eccentric billionaire.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by taylodl on Wednesday April 26, 2023 @11:19AM (#35715076)
"Move fast and break things" isn't entirely inappropriate in the world of non-consequential software, i.e. software not affecting lives or money. But for software affecting lives (people could die) or money (deposits and transfers could go awry) then "move fast and break things" is unethical. Obviously this bit would apply to things such as cars and airplanes, too. You really don't want us building the controls of a nuclear power plant, do you? Probably not.

I'm appalled the NTSB hasn't reigned in Tesla. I'm cynical enough to start wondering what officials they've "bought off."

Re:Tesla Again Paints a Misleading Story with Their Crash Data by programmarchy on Wednesday April 26, 2023 @12:41PM (#35716502)
Would it be unethical if FSD Beta causes 1,000 fatalities but FSD 1.0 prevents 1,000,000 fatalities? Real world training data is needed to get from Beta to 1.0. Seems like you are oversimplifying the ethical decision being made by NTSB.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by taylodl on Wednesday April 26, 2023 @01:27PM (#35717207)
I'm not interested in dying for Tesla. Real people, innocent people doing nothing wrong, have been killed. It's past time to stop this madness.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by AlotOfReading on Wednesday April 26, 2023 @01:32PM (#35717277)
Two points:

1) Tesla hasn't demonstrated that future hypothetical, so it's a speculative argument at best.

2) It's still unethical if they could have achieved that more safely by following industry norms and best practices, which they consistently fail to implement. Tesla could hire safety drivers for testing before public releases, but they don't. They could implement more redundancy to mitigate SPOF, but they don't. They could file the same regulatory paperwork others do (insufficient as that is), but they don't do that either. They don't even use industry standard terminology and safety concepts like ODDs.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by rurp on Wednesday April 26, 2023 @11:35AM (#35715414)
I put more of the blame on a related but slightly different principle, fake it till you make it. The subject matter makes a huge difference in how bad that approach is. Falsely claiming that an app uses AI to identify if a picture is a hot dog or not is dishonest, but not the end of the world. Lying about a medical test being valid, or that a car is fully self driving, is a whole other thing. Those lies directly result in people being killed and should not be tolerated.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by programmarchy on Wednesday April 26, 2023 @12:37PM (#35716448)
Agree that “fake it till you make it” is a good distinction to make. It’s also been glorified e.g. do things that don’t scale.

But technically, Tesla is “fully self driving” in the sense that it can autonomously navigate, steer, etc. That doesn’t mean it won’t crash. It’s also still in Beta.

In the long run, I think FSD will become better than the majority of human drivers. Seemingly, the only way these remaining edge cases can be solved is by collecting more training data from real world driving scenarios. So the NTSB is faced with the difficult decision of allowing this Beta version to crash and even cause fatalities in the short run, betting on the prediction it will drastically improve road safety in the long run. It’s a complicated dilemma, in my opinion.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by thworp on Thursday April 27, 2023 @04:11AM (#35724788)
> In the long run, I think FSD will become better than the majority of human drivers.

You fell for a very common misuse of statistics there. It may become better than the average human driver, but the sample for that average includes the 5-10% of drivers who cause almost all accidents. Like for other things where power laws apply using averages (or medians) on that data essentially removes any information.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by programmarchy on Thursday April 27, 2023 @09:38AM (#35727928)
I said majority, not average, although what I really meant was anyone who is not a professional driver. But seems like you’re making a stronger argument for my point than I am for putting FSD Beta on the road to replace that 5-10% of bad drivers even sooner.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by kaba0 on Wednesday April 26, 2023 @12:40PM (#35716496)
But you don’t advertise, let alone deploy a product when 90% of it is missing.

FSD likely requires GAI.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by programmarchy on Wednesday April 26, 2023 @12:48PM (#35716605)
Oh, but you do! Moloch demands it.

The GAI requirement is an interesting theory but why? I find it dubious because, at least personally, driving seems to occur semi automatically in my motor cortex. When a car pulls out in front of me I’m not using my frontal cortex to slam on the brakes. It feels involuntary.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by kaba0 on Wednesday April 26, 2023 @01:48PM (#35717511)
You have 86 billions of neurons with orders of magnitudes more connections between them — the motor cortex does its thing without conscious thought, but your brain still continuously processes the world using all of your senses, using its n years of experience/knowledge.

From a few anecdotal experiences in this thread, you would be able to tell subconsciously that that Burger King sign is not a stop sign, not even for a brief second, that floating plastic bag is not an object that one has to avoid collision with and there are just millions of edge cases humans properly handle.

Of course I might be wrong and it might not require GAI, but there is still no human construction that can even close on a human brain.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by brianwawok on Wednesday April 26, 2023 @10:09AM (#35713899)
So that's a good hunch. Where is the data showing that Tesla software is causing more crashes than say people driving base? Without data, why are you thinking that something should be not allowed on the roads? Opinions without data are just that.. opinions. Would be a pretty terrible way to regulate.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by NhanH on Wednesday April 26, 2023 @10:14AM (#35713988)
Wait what? Tesla should be the one providing the data showing that it is safe for their software to be on the road, not the other way round. Vehicles have always need to be regulated to be on the road, rather than retroactive ban after they kill a bunch of people.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by ChrisMarshallNY on Wednesday April 26, 2023 @10:24AM (#35714131)
> rather than retroactive ban after they kill a bunch of people.

I grew up in the US, in the 1970s-80s, when we had [optional] seatbelts, that would cut you in half, and snap your spine, exploding [leaded] gas tanks, glass that would slice you to ribbons, and steering wheels that would impale the drivers.

It's always been retroactive. Ralph Nader made his name on Unsafe at Any Speed[0].

Money speaks very loudly in the US, and we have always been willing to sacrifice quite a few things (as long as the non-money-makers are making the sacrifices), and take huge risks (as long as the non-money-makers are taking the risks), for money. It's just the way we are.

[0] https://en.wikipedia.org/wiki/Unsafe_at_Any_Speed

Re:Tesla Again Paints a Misleading Story with Their Crash Data by jjoonathan on Wednesday April 26, 2023 @10:52AM (#35714576)
The problems with this policy are obvious, but it brings benefits too: we are allowed to develop new technology. If self driving has to be rigorously proven before it can be tested, the chicken-egg problem simply resolves itself into "the tech won't be developed here." Is that really what HN wants?
Re:Tesla Again Paints a Misleading Story with Their Crash Data by kibwen on Wednesday April 26, 2023 @11:04AM (#35714806)
As a pedestrian and cyclist, what I want is to not become a statistic in a crash report. We can develop new things and test them under controlled conditions without having to put everyone outside the car at risk.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by jjoonathan on Wednesday April 26, 2023 @11:14AM (#35714991)
AI is easily our best bet against the true menace, which is distracted drivers.

No, "controlled conditions" don't do a very good job of training or proving an AI. Supervised cars on actual roads is the way it has to be.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by acdha on Wednesday April 26, 2023 @11:46AM (#35715614)
Speed limiters and automatic braking get most of the benefits without any need for hard AI problems. What AI promises is a way for governments not to have to take the heat for holding drivers accountable, but hundreds of thousands of people are being killed waiting for it to materialize.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by piva00 on Thursday April 27, 2023 @04:53AM (#35725155)
The best bet against the true menace is to deploy public policies that reduces the true menace: the number of cars/drivers on the streets.

That's the most sound policy, provide the public with alternative means of transportation that are convenient and more environment-friendly, leave room on the streets for the ones that actually require a car for their transportation. If you leave in the middle of bumfuck nowhere and can't be served by public transportation, great, you probably need a car. If you drive your car in cities for trips of 5-10km because it's convenient then we, as a society, should find ways to disincentivise this usage.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by anotherhue on Wednesday April 26, 2023 @12:17PM (#35716152)
https://youtu.be/fPF4fBGNK0U

Modern car crash test into older car.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by ChrisMarshallNY on Wednesday April 26, 2023 @01:14PM (#35717024)
Looks like the Malibu driver gets out, and cusses out the splattered remains of the Belair driver, who is removed from his car, with a teaspoon and a sponge.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by ajross on Wednesday April 26, 2023 @12:30PM (#35716321)
> Tesla should be the one providing the data showing that it is safe for their software to be on the road

The linked article is literally about the data Tesla provides showing that their vehicles are safe, and it doesn't even refute the conclusions. It's about nitpicking at the margins.

To be clear: Tesla's data says autopilot use is about an order of magnitude safer than human driving. The author complains that this is confounded by the fact that AP is used in different conditions where the baseline accident rate is lower.

You need a lot of confounding effect to make up for an order of magnitude delta! Seems like everyone wants to skip that part and yell about the CEO instead.

The cars are safe. They are extremely common vehicles now. If they were unsafe we would know. We know they are safe. Any argument needs to treat with this truth, or it's basically just a conspiracy theory.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by ra7 on Wednesday April 26, 2023 @12:42PM (#35716529)
> It's about nitpicking at the margins.

The article is not nitpicking at the margins. It's showing how Tesla is making misleading claims out of their insufficient data by not accounting for operating conditions. That's literally how Tesla is claiming Autopilot is "an order of magnitude safer than human driving".

> You need a lot of confounding effect to make up for an order of magnitude delta!

Or you could just make misleading comparisons to claim that. That's pretty easy too.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by ajross on Wednesday April 26, 2023 @12:54PM (#35716713)
It's just tiresome. You know the cars are safe. You want to say they're unsafe. But you can't, because they're safe. So you're yelling about what amounts to marketing strategy.

Which, fine. Everyone does bad marketing, there's lots to yell about. Maybe consider yelling about the deceptive marketing practices of a product you do use? There are lots to choose from.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by ra7 on Wednesday April 26, 2023 @12:58PM (#35716781)
"Our cars are safe"

"Show us unbiased data proving it"

"If it were unsafe, we would know"

Sigh.

I own a Tesla and use FSD, but thanks for assuming.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by ajross on Wednesday April 26, 2023 @01:30PM (#35717261)
They did show the data. You want to throw the data out instead of believing it. Nitpicks aren't winning arguments, and you know that. I'm saying that if you want to argue with someone's data, you need to argue with data and not just that some different experiment would be better.

What the linked article is doing is just excuse-making, basically.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by ra7 on Wednesday April 26, 2023 @01:37PM (#35717358)
Huh, what? It's completely reasonable to question the methodology. That's not nitpicking.

I get it. You want to take the data at face value without questioning anything.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by ajross on Wednesday April 26, 2023 @04:42PM (#35719704)
To be blunt: I don't take your words here to be a dispassionate "questioning of methodology". If that was your goal, you would at least nod to the numbers and the clear fact that even if the measurements were confounded they probably point to a safe system.

I'm not saying take it at face value at all. I'm happy to discuss methodology and to admit that the numbers on Tesla's site amount to something closer to marketing than science. But nonetheless, the cars remain safe. This methodology would have to be outrageously confounded to produce a result like this for an unsafe car, and you know it.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by clouddrover on Wednesday April 26, 2023 @08:04PM (#35721585)
> The linked article is literally about

Dude, you couldn't even get the date of the article right.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by MBCook on Wednesday April 26, 2023 @10:21AM (#35714080)
Only Tesla has that data, so no one can link to it.

If it showed things were better than average it would fit their message and I’d expect them to publish it.

If it showed things were average it would not fit their narrative. If it showed things were worse it would contradict their narrative.

Seems like there is only one reason to withhold numbers or publish them in a misleading way. They prove your claims that your tech is way safer wrong in some way.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by jjoonathan on Wednesday April 26, 2023 @10:32AM (#35714230)
Tesla has said they intend to pick the "better than human" fight at 5 billion miles, when they believe their advantage will be decisive rather than having an outcome that depends on how you count.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by netsharc on Wednesday April 26, 2023 @10:53AM (#35714580)
So... until they reach that number, they'll publish misleading stats (i.e. outcomes that favor them depending on how they count)?
Re:Tesla Again Paints a Misleading Story with Their Crash Data by hansvm on Wednesday April 26, 2023 @10:53AM (#35714589)
Even then there'll be a distribution shift effect they need to account for. Not everyone is allowed into the FSD program, and the fact that they're self-selecting to use FSD additionally biases the roads and conditions where they choose to do so. Moreover, how you count is still very relevant if all the hairy events happen when a human operator takes control -- the car screwed up, but the resulting crash gets blamed on the operator who couldn't react to the ensuing shitshow in time, and even if total crashes/fatalities are lower when counting those events you still have the self-selection problem of perhaps those FSD operators in those conditions being better at recovery from car-induced errors than the general population in arbitrary conditions would be.

Like...maybe it's fine. But even at 0 fatal crashes in 5 billion miles they won't have a strong argument that a more widely deployed FSD would have similar success without a lot more data to explain how the thing they measured directly connects to the thing they'll want to claim it represents.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by jjoonathan on Wednesday April 26, 2023 @11:01AM (#35714734)
Thank you for demonstrating my point. This is exactly why they want a safety margin on their safety margin.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by rurp on Wednesday April 26, 2023 @11:42AM (#35715535)
Then Tesla should stop making claims about safety until they are willing to back them up with evidence. The most likely scenario given the available information is that Musk is lying and Tesla's aren't as safe as the company would have us believe.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by jjoonathan on Wednesday April 26, 2023 @12:34PM (#35716401)
Tesla's claims from TFA are pretty cringe, but so are the calls to ban FSD on account of a horrible safety record that isn't actually horrible.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by MBCook on Wednesday April 26, 2023 @12:50PM (#35716649)
> account of a horrible safety record that isn't actually horrible.

That’s the problem. We don’t know the safety record because Tesla won’t release it.

But the anecdotal evidence we do have is very worrying. And the development model doesn’t inspire confidence.

So the calls to ban it seem very reasonable to me.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by gizmo on Wednesday April 26, 2023 @10:56AM (#35714643)
Okay so Musk loudly proclaims that buying a Tesla is the best financial investment on the planet, that buying anything else is pure insanity, on the basis of the car turning into a fully autonomous taxi via a future over the air update. Bold claim, no data provided.

Musk boasts that Teslas have the highest crash safety ratings ever, despite this being contradicted by the testing bodies (because they don't distinguish between cars with 5 star ratings). Another bold claim, contradicted by the data!

Teslas collect tons of data while driving and when crashing, which Tesla processes. You believe that this data demonstrates that FSD is safer than regular driving but that musk is too cautious to release it?? How can you square that with Musk's behavior generally?

Re:Tesla Again Paints a Misleading Story with Their Crash Data by jjoonathan on Wednesday April 26, 2023 @11:09AM (#35714874)
Musk is a bloviating idiot. As for FSD, I believe that FSD is better than a bad driver and that with supervision by a responsible driver it's fine to allow on the roads.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by MBCook on Wednesday April 26, 2023 @11:04AM (#35714800)
And yet “it’s safer than normal drivers” is the defense people have been using to defend AP/FSD for years.

But we don’t know that because Tesla won’t tell us.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by jjoonathan on Wednesday April 26, 2023 @10:22AM (#35714101)
Yes, and we have to mind the denominator too. Waymo just announced 1 million self driving miles, Tesla just announced 150 million self driving miles.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by ra7 on Wednesday April 26, 2023 @10:38AM (#35714319)
Waymo self driving is not at all the same as Tesla’s. One is fully driverless and the other requires driver monitoring.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by jjoonathan on Wednesday April 26, 2023 @10:50AM (#35714532)
Yes, but Tesla does have a driver monitoring, so that's the relevant safety number.

Nobody, even Tesla, is currently arguing that Tesla FSD is ready for driverless.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by tasty_freeze on Wednesday April 26, 2023 @10:59AM (#35714702)
You just pointed out that the two driving assists are apples and oranges ... yet it was you who compared Waymo's driverless car total mileage vs Tesla's FSD.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by jjoonathan on Wednesday April 26, 2023 @11:21AM (#35715123)
We are talking about safety and risk, not dick measuring the tech stack. Tesla has 150x the miles, which means that for the same risk level they should see 150x the problems. Maybe divide that by 3 to account for highway vs around town. I don't see 50x the number of "Tesla killed my dog" stories as "Waymo killed my dog" stories, so Tesla probably isn't taking egregious risks. What's your heuristic?
Re:Tesla Again Paints a Misleading Story with Their Crash Data by simondotau on Wednesday April 26, 2023 @10:14PM (#35722513)
This is correct but misleading. Waymo and Tesla are pursuing strategies so different that attempting to compare them is futile.

It's true that within the small geofences in which Waymo operates, their cars are dramatically less likely to come unstuck than a Tesla running FSD beta. On the other hand FSD beta drives on pretty much any public road and not a curated set of pre-driven, pre-mapped, pre-validated streets. Yes there are many geographies where it struggles; there's a cottage industry of people obsessively showing these on YouTube. There are also some areas of the country where FSD beta is utterly rock solid and people routinely drive substantial distances with zero interventions.

It's also not entirely accurate to describe Waymo cars as "fully driverless" as they have a team of human employees remotely monitoring the fleet and can remotely operate any vehicle.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by ra7 on Wednesday April 26, 2023 @10:23PM (#35722575)
> It's also not entirely accurate to describe Waymo cars as "fully driverless" as they have a team of human employees remotely monitoring the fleet and can remotely operate any vehicle.

This is absolutely not true. Waymo remote agents cannot operate a vehicle. All they can do is answer questions from the vehicle or plot a path to go around if it gets stuck. They cannot make any safety critical interventions. Waymo has talked about this many times.

It’s fully driverless because the vehicle is responsible for attaining minimal risk condition all on its own. This is how other L4 companies like Cruise works too.

Zoox has a good explanation on how their teleguidance works: https://youtube.com/watch?v=NKQHuutVx78

Re:Tesla Again Paints a Misleading Story with Their Crash Data by simondotau on Thursday April 27, 2023 @05:37AM (#35725542)
“Plot a path to go” is literally what it means to control the vehicle remotely.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by ra7 on Thursday April 27, 2023 @08:37AM (#35727109)
Nope, that’s misleading. Still no “control” over the vehicle because the vehicle is executing the move. It’s assisting the vehicle. They don’t have the ability to joystick the car.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by simondotau on Thursday April 27, 2023 @10:31AM (#35728705)
Your point is that the Waymo operator isn't really in control because the vehicle can ignore instructions; the on-board computer won't allow the remote operator's instructions to result in a collision. If I attempt to drive my own car into a brick wall, the on-board computer will defy my instructions as best it can too. By your definition, I'm not in control of my car just like Waymo operators aren't.

Fact is, a Waymo operator can take enough control of the vehicle to be considered in control of it. It doesn't matter if control comes in the form of a steering wheel or a joystick or drawing vectors on a map. Control is control, whether it's direct, indirect, or funnelled through a governor. Waymo operators can intervene and direct the car as needed.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by ra7 on Thursday April 27, 2023 @10:40AM (#35728855)
> If I attempt to drive my own car into a brick wall, the on-board computer will defy my instructions as best it can too. By your definition, I'm not in control of my car just like Waymo operators aren't.

Terrible analogy. You are sitting in the driver's seat with your hands on the wheel. If your car is about to hit someone, you can prevent it because you are the driver. This is what FSD is — ultimately driver is in control. No such luxury for Waymo/Cruise as their remote operators cannot do any safety critical interventions like preventing crashes.

All they can do is non-safety critical interventions by way of passing indirect commands. A Waymo is in control of itself at all times and is fully responsible for its own safety. You can play with words like "control" all you want, but this is the definition of SAE Level 4 autonomy.

If anything, calling FSD "autonomous" is highly misleading because drivers are preventing mistakes and thereby hiding its real safety outcome.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by simondotau on Thursday April 27, 2023 @09:46PM (#35736650)
> Terrible analogy.

I agree, it's a terrible analogy if I was attempting to make the argument you thought I was trying to make, per your explanation for why it's a terrible analogy.

My point is that it's invalid to say that Waymo operators don't have "control" of the vehicle because it can refuse to perform some tasks. Because my car can refuse to perform some tasks too.

The deeper point is that the difference between "in control" and "not in control" isn't binary. It's all points along a continuum. If a Waymo operator controls a vehicle remotely, it's not the same level of control as a human holding the steering wheel. But it's still control in the larger sense. If the operator wants the car to stop, it will stop. Period. If they want the car to perform some action that isn't stupid or dangerous (such as colliding with a pedestrian) it will perform that action.

> If anything, calling FSD "autonomous" is highly misleading

I agree. Which is why I didn't. In most situations FSD beta can handle the "full" task of driving. By "full", they mean it's not intended to be limited to a strict subset of task, e.g. only on highways. It can "fully self drive" the car competently at least ~99.9% of the time, as evidenced by the fact that it can routinely drive most roads reliably. Drives shown on YouTube are mostly owners intentionally looking for roads which flummox it, as that's how they show improvements as software updates are released.

The challenges which preclude FSD from being a system capable of autonomy — the 0.1% of remaining error — isn't errors in spatial awareness or control surface failure. It's stuff like path planning and road sign interpretation, neither of which involve sensors that Tesla vehicles lack.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by tsimionescu on Wednesday April 26, 2023 @10:53AM (#35714600)
Tesla has 0 self-driving miles, since a driver is always there and is fully responsible for any mistake that happens.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by lern_too_spel on Wednesday April 26, 2023 @12:01PM (#35715881)
Waymo had 20 million self driving miles on public roads in 2021. Earlier this year, Waymo announced 1 million self driving miles on public roads with nobody in the driver's seat. Tesla has 0 such miles.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by jjoonathan on Wednesday April 26, 2023 @12:39PM (#35716478)
Thanks for clarifying! So Tesla has 7x the miles and so if their test program is riskier we should expect to see >7x the number of accidents.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by lern_too_spel on Wednesday April 26, 2023 @04:11PM (#35719319)
We see far more than 7x at fault accidents. As far as I know, Waymo has had none. Tesla has had so many that it had to post a recall notice.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by bradtemp on Thursday April 27, 2023 @12:18AM (#35723246)
No because when Tesla's system has a problem, as my car does a few times each trip, I grab the wheel. And waymo also has cars with safety drivers but also has run a million miles without one. Run Tesla FSD with no intervention for a million miles and it would have thousands of accidents. Thousands, where it was at fault. Waymo had 2 or 3 minor parking lot style no damage contacts in their million. Not thousands
Re:Tesla Again Paints a Misleading Story with Their Crash Data by kaba0 on Wednesday April 26, 2023 @12:58PM (#35716786)
On motorways mostly, where the problem is almost trivial. If you add to it that it is much easier to accumulate miles there, Waymo’s number is much more impressive.

It’s a bit like stress testing two frameworks, one tested only for a day, but at the frontpage of HN, while the other was up for a months, with barely any clicks.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by jackmott42 on Wednesday April 26, 2023 @10:17AM (#35714032)
Many people take the view that you shouldn't introduce a radical change in how cars work until it is proven safe, rather than feeling it should be allowed on public roads until it is proven unsafe.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by try_the_bass on Wednesday April 26, 2023 @10:53AM (#35714595)
It seems like it's impossible to prove that it's safe on public roads without actually using it on public roads, though? Wouldn't that be an impossible ask, by definition?
Re:Tesla Again Paints a Misleading Story with Their Crash Data by cptcobalt on Wednesday April 26, 2023 @11:10AM (#35714901)
Exactly. There's no better facsimilie for the sheer variety of public roads than, well, public roads. Tesla even has rigorous simulation in place for hostile situations that should never occur on public roads:

A good general overview from two minute papers: https://www.youtube.com/watch?v=6hkiTejoyms Tesla's AI Day 2022 video, timestamped around labeling and simulation https://youtu.be/ODSJsviD_SU?t=6037

Re:Tesla Again Paints a Misleading Story with Their Crash Data by kibwen on Wednesday April 26, 2023 @11:09AM (#35714893)
It is entirely possible to test things under controlled trials to simulate real-world conditions. To use an analogy, we don't just test new medicines by putting them on the shelves and waiting for consumers to report side effects. We have strenuous trials first to give us baseline confidence in the product.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by try_the_bass on Wednesday April 26, 2023 @04:02PM (#35719203)
I would argue that it's impossible to simulate real-world conditions for a task as complex as driving. There are too many edge cases and different combinations of environmental factors, many of which involve the inherent unpredictability of other drivers.

I would assume medicines have similar or higher levels of complexity involved. However, the medicine analogy is poor. We often release medicines for use even when they have incredibly harmful side-effects. We do the testing to quantify and understand those side-effects, not prove that each medicine does exactly what it should with no side effects.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by kaba0 on Wednesday April 26, 2023 @12:54PM (#35716717)
I still see no reason why should a private company be allowed to risk the lives of those who never willingly participated in their study.

There are human trials for drugs as well, but those are only the latest phase, and with explicit permission.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by try_the_bass on Wednesday April 26, 2023 @03:50PM (#35719018)
Isn't the usage of Autopilot "willing participation"? Or are you referring to the other people on the road?

Wouldn't that also be true of your medicine analogy? If someone takes an experimental medicine but experiences an unknown side effect and passes out while driving, isn't the risk profile equivalent?

That hypothetical certainly is far less probable than the Autopilot case, but for any experiment that takes place outside controlled conditions, there can always be unknown and unforeseen consequences that affect people who have not given explicit consent to being part of said experiment.

To argue that we cannot test things unless all potentially-involved parties have given consent is to argue for an impossibility. There is always some small amount of risk of higher-order consequences.

I would even go further and say that arguing for such is an unnecessarily conservative approach that hamstrings any attempt at improving the world. See, for example, this commentary on the current state of IRBs [1]

[1] https://astralcodexten.substack.com/p/book-review-from-overs...

Re:Tesla Again Paints a Misleading Story with Their Crash Data by kaba0 on Wednesday April 26, 2023 @06:23PM (#35720815)
There are plenty of drugs after which you can’t drive.

Also, the “danger to others” aspect is even then negligible as opposed to some faulty software controlling a ton of steel/battery in a system that depends heavily on predictable behavior of each other.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by try_the_bass on Saturday April 29, 2023 @06:28PM (#35757877)
Safe driving for a human also depends heavily on predictable behavior of others. If that's an important metric, it seems like the optimal solution is a single self-driving system with a monopoly on the market... that way each and every driver is predictable, correct?

I guess I don't understand your argument. We put faulty humans in control of a ton of steel/battery in the same system all the time; humans have the disadvantage that when lessons are learned, they aren't transferrable without great amounts of effort. Self-driving systems can share learnings across the whole fleet with software updates, which seems like a strictly better solution in the long term.

It seems like you're making perfect the enemy of "better".

Re:Tesla Again Paints a Misleading Story with Their Crash Data by UncleEntity on Wednesday April 26, 2023 @11:50AM (#35715686)
There’s a slight difference between alpha/beta testing software on public roads and and something like… IDK, can’t think of anything even comparable that’s happened in my lifetime, anti-lock brakes maybe? Which, incidentally, fail safe and don’t happily run into stationary objects on a regular basis.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by simondotau on Wednesday April 26, 2023 @10:29AM (#35714187)
It’s rather telling that the reply saying “show me evidence” is being voted down while the assertions mixed with disdain for Musk are being voted up.

Look, I get that Musk isn’t popular here. But please, give me some hope for humanity and at least pretend to care about facts and evidence.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by jackmott42 on Wednesday April 26, 2023 @10:30AM (#35714205)
Our point of view is that we should not allow beta self driving software on the roads until it is proven safe. We do not know how safe it is, nor can we know because Tesla controls that data and is not transparent with it.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by simondotau on Wednesday April 26, 2023 @10:41AM (#35714391)
Should we allow teenagers to drive on the road before they have proven to be safe? We don’t know how safe they are.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by jackmott42 on Wednesday April 26, 2023 @10:45AM (#35714470)
No, we should require that they pass a driving test, pay for insurance, and register their vehicle with license plates. If I were emperor I would raise the driving age to 18 as well.

vote often, vote early

Re:Tesla Again Paints a Misleading Story with Their Crash Data by simondotau on Wednesday April 26, 2023 @10:54AM (#35714603)
A person who was passed a driving test, paid for insurance and registered the vehicle is responsible for the car at all times, even when FSD beta is operating.

Come to Australia, the driving age here is 18. (And for your first three years as a licensed driver, you have to show plates to indicate your lack of experience because, unlike in the stupid USA, we don’t assume that passing one driving test is enough to qualify you as a “good driver”.)

Re:Tesla Again Paints a Misleading Story with Their Crash Data by tsimionescu on Wednesday April 26, 2023 @10:55AM (#35714626)
No, and we don't. That's why driving instruction and driving tests exist.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by simondotau on Wednesday April 26, 2023 @10:58AM (#35714688)
Thirty thousand people die on US roads every year because of the actions of people who received driving instruction and passed a driving test.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by rootusrootus on Wednesday April 26, 2023 @11:14AM (#35714974)
This is a better argument for improving training and testing than it is in lowering the bar and letting a buggy computer program drive.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by jjoonathan on Wednesday April 26, 2023 @11:49AM (#35715668)
Do you really think there's more room to improve human nature than AI technology? I don't.

I think they both have a ceiling and that the ceiling on AI is much higher.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by rootusrootus on Wednesday April 26, 2023 @11:53AM (#35715760)
Yes? The largest causes of accidents are fairly well understood, if we decided it were worth the effort. Not coincidentally, this is why all the arguments for self-driving fall flat. Being as good as an average driver is a low bar. Being as good as a median driver is a harder task. But it's the latter that is the bar we have to pass if self-driving cars are ever to become mainstream.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by jjoonathan on Wednesday April 26, 2023 @12:16PM (#35716124)
Deaths = N*average, not N*median.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by rootusrootus on Wednesday April 26, 2023 @01:44PM (#35717452)
I was not trying to claim otherwise. But unless you are intending to make self-driving cars mandatory, N*average is meaningless. The median driver is who you actually need to convince, and they are not going to choose a self-driving car that is less safe than they are.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by simondotau on Wednesday April 26, 2023 @09:42PM (#35722236)
It was only intended as an argument as a direct response to the post by tsimionescu. Tesla could focus on making FSD beta satisfy the driver test given to teenagers. It could perform the test as well as any 16-year-old and we'd all agree that it wouldn't really prove anything about the safety of FSD or the human teenager.

Which is my point — the road is full of hideously bad/dangerously inexperienced human drivers holding driver licenses. Given this, it's hard for me to interpret the pearl-clutching around humans co-driving with FSD beta as anything other than confected paranoia.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by kibwen on Wednesday April 26, 2023 @11:11AM (#35714926)
And ubiquitous FSD could easily make that number worse, not better.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by kaba0 on Wednesday April 26, 2023 @01:07PM (#35716932)
Many (most?) accidents are due to a clearly in the wrong driver (drunk-driving, texting, etc), and the other parties have no way of avoiding that. How exactly would a few self-driving cars help here? They can’t prevent a collision when the other party goes over a red light at some insane speed. They could start breaking sooner, which is great, but that doesn’t need self driving, it is a feature of plenty of cars already.

Of course if every car would be self driving we wouldn’t have crazy drivers, and accidents would diminish, but so would if we simply didn’t have crazy drivers. Neither is feasible in the near future, and in the short term, humans are much better at handling tricky situations (like.. not emergency braking at the sight of a plastic bag in the air)

Re:Tesla Again Paints a Misleading Story with Their Crash Data by hnburnsy on Wednesday April 26, 2023 @10:57PM (#35722794)
I'd bet that Tesla FSD could pass most DMV driving tests in the US.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by ndsipa_pomu on Thursday April 27, 2023 @04:39AM (#35725026)
That'd be really interesting to see how well it does.

I wonder why there's no modified version of driving tests for AVs that each software iteration takes.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by slg on Wednesday April 26, 2023 @11:02AM (#35714755)
I totally understand where you are coming from. However, I don’t think it is possible to prove this type of technology is safe in the real world without lots of data of it being used in the real world. Requiring proof first like you suggest creates a catch-22 situation in which self driving technology can never be released.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by rootusrootus on Wednesday April 26, 2023 @11:13AM (#35714956)
Automakers already use proving grounds. We can set a minimum standard for FSD before turning it loose with amateur drivers.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by slg on Wednesday April 26, 2023 @11:27AM (#35715249)
You can’t test self driving tech the same way you can test most safety technology. It is easy to test something like an airbag. You throw dummies in the seats and run the car into a wall. There is no equivalent for self driving tech. The tech needs to be able to handle any weird situation that humans and nature throw at it. You therefore need a huge number or interactions, billions of miles worth, to be confident in its safety. You can’t just put a car through a test track to see if it is safe. The range of situations the technology needs to be able to respond to is too large to fully test like this.

It is a perfectly valid policy to want that proof ahead of time. I’m just pointing out that this requirement would effectively kill development of this technology for the foreseeable future.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by rootusrootus on Wednesday April 26, 2023 @11:59AM (#35715856)
Is Tesla using customer cars for training data? That should be very noticeable, it is a lot of data that would be getting fed back. If they're not, then the billions of miles driven by customers isn't relevant, and the same "can't just put a car through a test track" problem exists at the training level.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by jjoonathan on Wednesday April 26, 2023 @12:01PM (#35715887)
Yes they are, yes it is very noticeable, and yes it is a lot of very important data that could not have been collected on a test track.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by rootusrootus on Wednesday April 26, 2023 @01:47PM (#35717497)
I'd like to see something to back that claim. The amounts of data we're talking about are quite significantly more than any I've seen people experience in real life. As far as I can tell, customer cars run inference only, collect very little data unless something prompts them to (and even then, store it locally), and contribute almost zero to the training set.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by jjoonathan on Wednesday April 26, 2023 @04:30PM (#35719524)
Here's a statement from 2022. They had a labeling team of 1500 people and they laid off about 200 after the labeling infrastructure team finished an auto-labeler, so it's not just a bloated team. Do you think they are keeping 1300 people busy correcting labels on purely internal data?

https://teslamotorsclub.com/tmc/threads/tesla-lays-off-over-...

Re:Tesla Again Paints a Misleading Story with Their Crash Data by UncleEntity on Wednesday April 26, 2023 @12:09PM (#35716012)
Google’s robocars seem to be taking a very conservative approach to integration with the motoring public.

Don’t get me wrong, I irrationally hate the robots, used to see them all the time around Phoenix, was actively gunning for them and only had one time I could have rammed one[0] with it not being my fault. Which says a lot because it was (well, still is) a life goal to take out a robocar so I was really trying.

I used to see them doing a bunch of really stupid stuff but never anything that was outright dangerous, relatively speaking. One did stop in the fast lane when everyone was zipping by at 70+ because it couldn’t figure out how to merge into the left hand exit ramp but plenty of snow birds do that too so it’s not completely unheard of.

[0] (un)fortunately I was behind on my rent and couldn’t afford to spend who knows how long dealing with an accident investigation so the robot got to go about its day unmolested.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by rootusrootus on Wednesday April 26, 2023 @01:51PM (#35717540)
Google's approach is more defensible. They are careful, default to conservative behavior and stop when confused, and had professional drivers for years. And even then they're a road hazard.

At least they hold liability if anything happens, though, which is an important step.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by kaba0 on Wednesday April 26, 2023 @01:01PM (#35716830)
Also, since parts of it is a blackbox, doesn’t any update literally clears out any former result and should be revalidated from scratch?
Re:Tesla Again Paints a Misleading Story with Their Crash Data by ndsipa_pomu on Wednesday April 26, 2023 @11:51AM (#35715705)
The sensible method is for the manufacturer to perform lots of testing and make available the data. Legislators can then allow limited real world usage to determine if there's problems and then expand that usage as appropriate. e.g. allow autonomous vehicles to take control on motorways (sorry, that's a UK term - is it freeways in the U.S.?).
Re:Tesla Again Paints a Misleading Story with Their Crash Data by jjoonathan on Wednesday April 26, 2023 @12:00PM (#35715869)
That's exactly what happened. There was a back and forth with NHTSA for years before the beta started going public, and the rollout was carefully staged. At first, you needed a high safety score and it was aggressively geofenced. Those restrictions were gradually lifted as they collected data, and it still has attentiveness monitoring and a strike system. Tesla and NHTSA go back and forth on details all the time -- just recently NHTSA demanded some adjustments for stop signs and yellow lights.
Re:Tesla Again Paints a Misleading Story with Their Crash Data by bmitc on Wednesday April 26, 2023 @10:59AM (#35714716)
> Look, I get that Musk isn’t popular here. But please, give me some hope for humanity and at least pretend to care about facts and evidence.

The onus is on Tesla to provide honest and accurate data, and they have shown time and time again that they are not capable of doing so.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by kaba0 on Wednesday April 26, 2023 @12:41PM (#35716515)
Where is the data showing that heroin is not good at curing COVID?
Re:Tesla Again Paints a Misleading Story with Their Crash Data by starbase on Wednesday April 26, 2023 @12:05PM (#35715953)
> only to be used with the driver constantly monitoring and being aware, but that's an unrealistic expectation

FSD monitors the driver for indicators of inattention, e.g. not looking at the road. First you get a visual alert, then a shrill alarm, and if you're still not paying attention the vehicle slows to a stop. Drivers with a history of inattention are locked out of FSD.

Contrast with traditional cruise control where you can fall asleep at the wheel going 100mph and it'll hold that speed until you crash. Of course no one wrings their hands about that.

Re:Tesla Again Paints a Misleading Story with Their Crash Data by kaba0 on Wednesday April 26, 2023 @12:36PM (#35716436)
People suck at context switching. Even if the driver is looking at the road, they can’t suddenly be put in the context and expect to do well.