News for hackers. Stuff that matters.
Re:Alarmed by Tesla’s self-driving test, state legislators d... by gadnuk on Sunday December 12, 2021 @12:17PM (#29531411)
As they should, from all agencies involved. It is absolutely horrifying to see Tesla do this open beta test on public roads when no other non-Tesla entities (other cars, pedestrians, motorcyclists, bicyclists, etc) consented to being a part of a reckless experiment.

Moreover, Tesla influencers on social media tend to cherry pick and show only the nicer parts of their FSD Beta drives where no incidents and disengagements occur. Whereas you will often see in the comments some Beta users disagreeing and often showing the scary bits. And of course the pattern of Tesla influencers acting like an echo chamber absolutely disagreeing with anything critical of Tesla, jumping to Musk's defense at every turn because..."My mission!". An example:

https://mobile.twitter.com/taylorogan/status/146940457943982...

A thread of the scariness of this Beta test on public roads:

https://twitter.com/Tweet_Removed/status/1438553523369615364...

Elon Musk has a history of overestimating Tesla's capabilities when it comes to autonomy. And also flouting regulations to reach the end goal. He wants to make people believe in the illusion that Tesla are in some unsurmountable lead when it comes to autonomy but they are actually playing catchup and are dead last because of the approach they took.

Here's a timeline of Musk dangling the carrot of full autonomy (SAE Level 5) for over 6 years now.

https://www.reddit.com/r/SelfDrivingCars/comments/n6nsmt/elo...

But people argue, "Oh, but they are getting better and eventually will iron out all the edge cases!". This is not a matter of just making some settings change and things magically fix themselves. These are safety critical systems and not considering edge cases while advertising the feature as "Full Self-Driving" can lead to fatalities. The edge cases don't seem to be finite and no amount of "Dojo will solve this!", "The system is learning more and more and will reach there!" will solve the problem with their approach. At some point, he will have to eat humble pie and incorporate more sensors to increase safety. But with the ongoing chip shortage and the fact that they have to sell as many cars as possible lest the stock promotion crumbles makes it an even harder task.

It's always some next version that will blow your mind. It's always the next version that's almost there.

https://twitter.com/elonmusk/status/1435967157662150675?s=20

https://twitter.com/elonmusk/status/1469541536128020485?s=20

Re:Alarmed by Tesla’s self-driving test, state legislators d... by ra7 on Sunday December 12, 2021 @12:34PM (#29531575)
It’s not just Tesla influencers vehemently defending FSD, but videos showing dangerous FSD behavior are also taken down very quickly using DMCA. It seems like there is a concerted effort to suppress “bad videos” that breaks the self driving narrative.

Latest example: https://twitter.com/mostlyharmlessz/status/14694217625553510...

Re:Alarmed by Tesla’s self-driving test, state legislators d... by beeboop on Sunday December 12, 2021 @02:40PM (#29532874)
The DMCA take down was by the original recorder of the video towards the person that re-uploaded it on Youtube without permission. Tesla had nothing to do with it.
Re:Alarmed by Tesla’s self-driving test, state legislators d... by ra7 on Sunday December 12, 2021 @04:39PM (#29533904)
I didn’t say Tesla had anything to do with it and I don’t know who is prompting them. What’s clear is that DMCA takedowns are now a pattern for “bad” FSD videos.
Re:Alarmed by Tesla’s self-driving test, state legislators d... by beeboop on Tuesday December 14, 2021 @08:21PM (#29560773)
There is no pattern
Re:Alarmed by Tesla’s self-driving test, state legislators d... by catillac on Sunday December 12, 2021 @12:36PM (#29531604)
The Tesla influencers — the explicit and implicit ones — have really soured me on the brand. I have driven in the original Tesla, loved the model S, owned a model Z, and had a cybertruck on order for a while (and intended to follow through with the purchase). I am a big Tesla fan, but the constant stream from the influencers rings like the “no matter what, this event is good for crypto” people. No matter what, Tesla acolytes jump in and only show the good things and rail against anything bad. I have cancelled my cybertruck order partially because of this behavior, Elons behavior, and in no small part because I saw a Rivian on the road the other day!
Re:Alarmed by Tesla’s self-driving test, state legislators d... by ximeng on Sunday December 12, 2021 @12:41PM (#29531649)
You’re saying that Tesla influencers pick and choose only the best videos on social media. This whole article is about videos of poor self-driving of Tesla cars, and you post a video of bad self-driving. The videos I’ve seen show some good and some bad automated manoeuvres.

Even if what you’re saying is right about influencers picking and choosing the best videos, it’s clear that there are videos of poor behaviour as well.

With so many videos out there I think it’s pretty clear what you’re getting with FSD regardless of the name. It is glitchy and unreliable and can get random safety issues with software regressions.

At the same time when it works it works pretty well, and it does also seem to be improving rapidly based on the videos that I’ve seen. A long way to go but it’s getting better.

It’s also not clear they’re dead last - they may be but there’s lots of people using it now and showing videos, which is harder to see for other companies.

You might have good points here but I don’t think it’s as black and white as you make out regarding how effective Tesla’s approach is with respect to safety, degree of progress, feasibility with current sensors, feasibility in general, misleading market, and general motivations and morals.

Re:Alarmed by Tesla’s self-driving test, state legislators d... by sva_ on Sunday December 12, 2021 @12:24PM (#29531477)
> https://mobile.twitter.com/taylorogan/status/146940457943982...

Damn, the part where he tried to take over and the car wouldn't let him for a while, was downright scary

Reminds me of a famous quote...

> "I'm sorry, Dave. I'm afraid I can't do that."

I fell like there should be a hardware way of taking over that overwrites anything the software does.

Re:Alarmed by Tesla’s self-driving test, state legislators d... by mcot2 on Sunday December 12, 2021 @12:33PM (#29531561)
There is. Tapping the brake pedal.
Re:Alarmed by Tesla’s self-driving test, state legislators d... by TigeriusKirk on Sunday December 12, 2021 @12:50PM (#29531753)
I believe Tesla testing FSD on open roads is probably going to cost lives. I think they're aware of the game they're playing and they're taking more risks than is responsible.

I also believe the driver in that video doesn't have the level-headedness to be testing anything anywhere. Which is a criticism both of the driver and of Tesla for letting people like that run the software on the open road.

Re:Alarmed by Tesla’s self-driving test, state legislators d... by mcot2 on Sunday December 12, 2021 @12:59PM (#29531837)
I think it is a calculated risk to get to autonomy faster and thus save lives.
Re:Alarmed by Tesla’s self-driving test, state legislators d... by TigeriusKirk on Sunday December 12, 2021 @01:09PM (#29531962)
Yes, I do think that's what their game is. Which I'm not inherently opposed to. But I think that at present they're taking more risk than I'm comfortable with having on our public streets.
Re:Alarmed by Tesla’s self-driving test, state legislators d... by sundaeofshock on Sunday December 12, 2021 @02:36PM (#29532834)
Sure, there is a risk pedestrians and people in other cars will die. However, Elon is brave enough to take that risk!
Re:Alarmed by Tesla’s self-driving test, state legislators d... by landa on Sunday December 12, 2021 @12:43PM (#29531687)
Exactly. If you press the brakes the system gives complete control back to the driver. It's interesting to see all of the comments about the "horrifying" experiments Tesla is doing, and quoting science fiction movies about how robots are going to murder you. So much sensationalism.
Re:Alarmed by Tesla’s self-driving test, state legislators d... by mcot2 on Sunday December 12, 2021 @01:00PM (#29531854)
The FUD is unreal.
Re:Alarmed by Tesla’s self-driving test, state legislators d... by dhruvdh on Sunday December 12, 2021 @12:54PM (#29531786)
I’ve read on r/selfdriving that he did take over, the “take over” alert just lingers for a few seconds.
Re:Alarmed by Tesla’s self-driving test, state legislators d... by ModernMech on Sunday December 12, 2021 @01:01PM (#29531862)
> https://mobile.twitter.com/taylorogan/status/146940457943982...

> He wants to make people believe in the illusion that Tesla are in some unsurmountable lead when it comes to autonomy but they are actually playing catchup and are dead last because of the approach they took.

I'm sorry, but yeah, the results in that video are worse than what we had 14 years ago after the DARPA Urban Challenge. I'm actually astounded how bad it is. An insurmountable lead this is not, and points to how much of an advantage LIDAR is.

Also, while we all have our robot failure blooper reels, this is a system that's live and in production, and Tesla should be ashamed to release this even under the "Beta" label.

Re:Alarmed by Tesla’s self-driving test, state legislators d... by mcot2 on Sunday December 12, 2021 @02:03PM (#29532499)
Correct me if I am wrong but the approach used by most in the DARPA challenge was lidar using pre-mapped routes and heavy use of localization. If the route changed significantly I think those cars would have trouble.

I belive Teslas approach might currently feel behind but has much more “headroom”. As Elon states the team have gone down many paths that lead to a local maximum which is short of the actual end goal. They firmly belive that an end-to-end system has to be based on vision and has to be able to drive in any situation the very first time without localizing itself to a preset path.

Re:Alarmed by Tesla’s self-driving test, state legislators d... by ximeng on Sunday December 12, 2021 @02:10PM (#29532560)
https://m.youtube.com/watch?v=0wJAANgG-Vg You mean this? It looks much less capable and a much more constrained environment than Tesla deals with.
Re:Alarmed by Tesla’s self-driving test, state legislators d... by ModernMech on Sunday December 12, 2021 @04:05PM (#29533609)
MIT was in a collision and probably should have been disqualified, so not the best example. Look up Boss from CMU.

Moreover, what I said was after the DUC. The results you see at the DUC were the culmination of a little over a year’s worth of work. They were at best prototypes constructed under great pressure in a competition setting. A lot of what you see there was held together by duct tape and 80/20, and the code was not something you’d want to bet your life on.

But things did improve rapidly soon after, as results were disseminated, the community began to understand what worked and what didn’t in designing these systems.

Re:Alarmed by Tesla’s self-driving test, state legislators d... by amelius on Sunday December 12, 2021 @12:28PM (#29531511)
The problem is that self-driving is almost entirely about edge-cases. And machine learning can optimistically only reach about 99% accuracy, so that last 1% of edge cases is where the real problem lies.
Re:Alarmed by Tesla’s self-driving test, state legislators d... by ChuckNorris89 on Sunday December 12, 2021 @12:30PM (#29531533)
Yeah, but the issues the Tesla seems to have in the video above (pedestrians crossing, rail tracks, bus lanes, parked UPS trucks) are hardly 1% edge cases, but common occurrences that are in every city.

And it wasn't even rush hour through some crowded European city like Rome with people on scooters zooming in every directions, in poor weather conditions at night, it was broad daylight in a city with barely any traffic.

If it can't handle basic city driving properly, then I'm sorry.

Re:Alarmed by Tesla’s self-driving test, state legislators d... by ec109685 on Sunday December 12, 2021 @01:34PM (#29532202)
Agree with you, but that area in downtown San Jose is very weird to drive around given their light rail system.

Not defending Tesla for all of those mistakes, but as a human, it’s easy to end up going down the wrong lane.

Re:Alarmed by Tesla’s self-driving test, state legislators d... by TigeriusKirk on Sunday December 12, 2021 @01:53PM (#29532384)
I've personally seen cars in those San Jose train lanes enough times to wonder just how common it is.
Re:Alarmed by Tesla’s self-driving test, state legislators d... by bittercynic on Sunday December 12, 2021 @12:40PM (#29531639)
I think there's disagreement about what 1% means - far less than 1% of my time spent operating a car involves interaction with a UPS truck, but more than 1% of my trips do.

Asking as someone with no first hand experience with these systems - do they complete 99% of trips with no disengagements or unexpected behavior, 99% of time driving, something else?

Re:Alarmed by Tesla’s self-driving test, state legislators d... by m4nu3l on Sunday December 12, 2021 @12:41PM (#29531651)
I'd be curious to know what definition of edge-case you are using. I think self-driving can't be entirely about edge-cases by definition (of edge-case).
Re:Alarmed by Tesla’s self-driving test, state legislators d... by brewdad on Sunday December 12, 2021 @12:50PM (#29531757)
Sure 99% of driving is pointing the car straight, keeping it between the lines and avoiding the car in front of you. That's easy and has been essentially solved by dozens of car makers.

The "edge" cases are pretty much everything else. There are a near infinite number of possibilities here and it is clear that no one is anywhere near close enough to covering them all. Stopping for a pedestrian when turning right is not some completely unforeseeable event.

Re:Alarmed by Tesla’s self-driving test, state legislators d... by m4nu3l on Sunday December 12, 2021 @01:02PM (#29531870)
I get it. However what matters the most in my view is the long term ratio of serious accidents in self-driving vs human driving. There is no need to cover all possibilities for that, right? The only problem with Tesla is IMHO that the name FSD is misleading.
Re:Alarmed by Tesla’s self-driving test, state legislators d... by amelius on Sunday December 12, 2021 @01:34PM (#29532210)
> long term ratio of serious accidents in self-driving vs human driving

Human driver as in: average driver, or best driver?

Re:Alarmed by Tesla’s self-driving test, state legislators d... by clairity on Sunday December 12, 2021 @12:49PM (#29531749)
you’re talking about the definition of a single edge case. you can argue about the exact proportion, but it’s entirely within the realm of possibility that real world conditions are dominated by an amalgamation of many different edge cases that together add up to many percentage points.
Re:Alarmed by Tesla’s self-driving test, state legislators d... by laurent92 on Sunday December 12, 2021 @12:22PM (#29531460)
Thank you for providing the video, the situation is appalling.
Re:Alarmed by Tesla’s self-driving test, state legislators d... by andrelayer on Sunday December 12, 2021 @12:29PM (#29531525)
There is the argument that they are already safer than human drivers though and it'd be morally objectionable to stop. Not saying I'm completely on that side, but it is a valid utilitarian argument.
Re:Alarmed by Tesla’s self-driving test, state legislators d... by mlyle on Sunday December 12, 2021 @12:34PM (#29531570)
Have you watched some of these videos in question? These videos of autonomous city driving are so bad that this claim seems absolutely laughable to me.

The burden of proof is on the person making the claim of safety. For Autopilot, the argument was made comparing known AP deaths per total AP miles vs auto deaths vs. driving miles of the entire US fleet... when the former almost certainly didn't include a share of the deaths and was driven under less demanding conditions (highway miles).

Re:Alarmed by Tesla’s self-driving test, state legislators d... by triska on Sunday December 12, 2021 @12:36PM (#29531603)
This argument seems not fully thought through: First, "already" makes it appear that this property is monotonically increasing, i.e., that they will stay safer from now on, even if more people use this feature. From what we see in the video, it seems this cannot be concluded: If this technology is used in more vehicles, it would appear that also the rate of accidents may increase, possibly rendering it less safe in total. We do not know how many accidents were avoided because other drivers prevented them. Second, the types of accidents will likely also change, in a way that in total could make the technology less safe. Third, what if the drivers are not fully alert all the time, as they appear in this video, to quickly take over when the technology fails in such colossal ways as we see in the video, does it still remain safer?
Re:Alarmed by Tesla’s self-driving test, state legislators d... by loeg on Sunday December 12, 2021 @12:32PM (#29531555)
The detractors don't disagree with the argument, but instead opine that current evidence does not support the premise.
Re:Alarmed by Tesla’s self-driving test, state legislators d... by pengaru on Sunday December 12, 2021 @12:41PM (#29531660)
That argument is bullshit built on aggregate Tesla Autopilot miles driven, which are largely cherry-picked ideal condition miles vs. human miles driven in all conditions.
Re:Alarmed by Tesla’s self-driving test, state legislators d... by eganist on Sunday December 12, 2021 @12:35PM (#29531579)
If this argument holds consistently with every subset of cases, possibly. But for certain edge cases, humans still consistently outperform Tesla fsd (white trucks against the sun, for example) [citation needed], which means in certain scenarios that cannot be foreseen, the risk to the non consenting public is higher than with the average driver.

Ergo there's a predictable and preventable source of accidents that must be suppressed.

Re:Alarmed by Tesla’s self-driving test, state legislators d... by beached_whale on Sunday December 12, 2021 @12:41PM (#29531658)
Distracted human drivers are terrible. People, in general, are easily and eagerly distracted. Otherwise the distance per accident driven would be much much higher. https://insideevs.com/news/542336/tesla-miles-driven-between...
Re:Alarmed by Tesla’s self-driving test, state legislators d... by numpad0 on Sunday December 12, 2021 @12:41PM (#29531655)
There’s no such argument, but a dirty extrapolation and implication. They argue:

a) [Broadly speaking], cars [from traditional big autos] with ADAS features are objectively safer, and,

b) Tesla Autopilot is [in traditional sense] an ADAS system, which,

c) [implies this set of facts alone make Tesla cars and implementations statistically safer] is cool, huh? Would be silly if you didn’t agree with me.

I don’t call it clever.

Re:Alarmed by Tesla’s self-driving test, state legislators d... by ModernMech on Sunday December 12, 2021 @12:44PM (#29531690)
They are safer than some human drivers in some conditions. They are not safer than every human driver in every condition though, so you'd need more to make a valid utilitarian argument.
Re:Alarmed by Tesla’s self-driving test, state legislators d... by loeg on Sunday December 12, 2021 @01:42PM (#29532303)
The utilitarian argument doesn't require that they be better than every human driver in every condition -- just that they be better enough against the average situation that outcomes are net better.
Re:Alarmed by Tesla’s self-driving test, state legislators d... by ModernMech on Sunday December 12, 2021 @02:23PM (#29532692)
I don't think that's right, because human drivers are exceedingly good at handling the average situation. If they weren't, you'd have accidents literally all the time. The average situation is accident-free. How much can you improve on that?

The utilitarian argument for driverless cars needs to be that driverless cars are better at handling the edge cases than humans, because that's when accidents happen.

Re:Alarmed by Tesla’s self-driving test, state legislators d... by loeg on Sunday December 12, 2021 @02:47PM (#29532935)
I think you’re confusing “better” and merely “good,” as well as “average” and “mode.”

The average situation is maybe 0.99 accident-free (made up number for illustration). You improve on that by being 0.995 accident-free, which is better.

I agree that “safer than some human drivers in some conditions” is insufficient.

Re:Alarmed by Tesla’s self-driving test, state legislators d... by ModernMech on Sunday December 12, 2021 @04:52PM (#29534016)
What I'm saying is that you can't design a car to handle the average driving situation and expect to really put a dent in the accident rate, because accidents are highly correlated to particular situations. For instance, if all of a town's accidents happen in a highly foggy area, but your driverless car cannot handle the fog because it's been designed to handle the average situation (not fog), then how will it reduce accidents? I would think that to reduce accidents it would have to be designed to work in the exceptional case (fog).

Maybe I'm confusing the idea of average and mode, so if I am an example of what you have in mind for an average situation would help.

Re:Alarmed by Tesla’s self-driving test, state legislators d... by ronnier on Sunday December 12, 2021 @12:31PM (#29531543)
The hard part is in the city. It is probably already a lot safer on the highways.
Re:Alarmed by Tesla’s self-driving test, state legislators d... by mcot2 on Sunday December 12, 2021 @12:31PM (#29531546)
As someone who is actively participating in the beta you couldn’t be more off base in your assertions. It sucks to see progress stifled by people that have no idea what they are talking about. With the thousands of people actively using the FSD Beta safely, show me significant evidence of an increased level of accidents that have occured. You can’t because the evidence does not exist.
Re:Alarmed by Tesla’s self-driving test, state legislators d... by mygoodaccount on Sunday December 12, 2021 @12:40PM (#29531637)
Tesla doesn't publish data nor shares it with the NHTSA, so that's very difficult to do. The only """data""" we have are videos uploaded to YouTube by a select group of Tesla owners who have access to the beta. Even ignoring the bias in videos selected for upload by the beta testers, every single city driving clip I've seen has several illegal maneuvers and many more disengagements.
Re:Alarmed by Tesla’s self-driving test, state legislators d... by TigeriusKirk on Sunday December 12, 2021 @12:55PM (#29531801)
That's more an indication of the clips you select to watch. I've seen half hour videos with no problems whatsoever.

We can't really draw any conclusions from self-selected video clips.

I do think the data should be openly available for all to study an analyze. If that helps competitors, then that's the price for testing in public.

Re:Alarmed by Tesla’s self-driving test, state legislators d... by mcot2 on Sunday December 12, 2021 @12:43PM (#29531688)
There are thousands of people using the beta safely. Try actually delving into the numerous communities online discussing the beta rather than being swayed by influencers.
Re:Alarmed by Tesla’s self-driving test, state legislators d... by kadoban on Sunday December 12, 2021 @12:36PM (#29531600)
"the evidence does not exist" because it's not true or because Tesla is hiding it? We should know which, and these legislators asking questions seems to be a good start towards getting answers.
Re:Alarmed by Tesla’s self-driving test, state legislators d... by randyrand on Sunday December 12, 2021 @12:41PM (#29531659)
How could Tesla hide something that happens on public roads?

If a tesla is at-fault, there’s another non-tesla party in the accident and police and dmv usually involved.

Re:Alarmed by Tesla’s self-driving test, state legislators d... by kadoban on Sunday December 12, 2021 @12:46PM (#29531716)
They can hide it by discouraging anyone from having enough answers to draw conclusions. What's one cop going to do? It'll get written up sloppily in one report, _maybe_ if they think it's important, and that'll be it. There usually won't be enough details of any sort.
Re:Alarmed by Tesla’s self-driving test, state legislators d... by mcot2 on Sunday December 12, 2021 @12:41PM (#29531650)
Because its not true at all. Most major Tesla incidents of any kind make headlines from fires to accidents on AP. You should do some basic research on the topic.

https://www.theverge.com/platform/amp/2021/10/21/22738834/te...

The FUD is _insane_ with Tesla.

Re:Alarmed by Tesla’s self-driving test, state legislators d... by kadoban on Sunday December 12, 2021 @12:44PM (#29531691)
If it's not true, Tesla should be overjoyed to share raw data (not processed through their marketing department) then.
Re:Alarmed by Tesla’s self-driving test, state legislators d... by mcot2 on Sunday December 12, 2021 @12:49PM (#29531747)
I don’t think they even really have a traditional marketing department. The beta release notes are probably something you should check out.

Latest:

Improved object detection network architecture for non-VRUs (e.g. cars, trucks, buses). 7% higher recall. 16% lower depth error, and 21% lower velocity error for crossing vehicles.

New visibility network with 18.5% less mean relative error.

New general static object network with 17% precision improvements in high curvature and nighttime cases.

Improved stopping position at unprotected left turns while yielding to oncoming objects, using object predictions beyond the crossing point.

Allow more room for longitudinal alignment during merges by incorporating modeling of merge region end.

Improved comfort when offsetting for objects that are cutting out of your lane.

Re:Alarmed by Tesla’s self-driving test, state legislators d... by kadoban on Sunday December 12, 2021 @01:11PM (#29531975)
They _absolutely_ have a marketing department, PR whatever you want to call it.

Those numbers don't look useful for judging safety. How would one compare those against anything else?

Re:Alarmed by Tesla’s self-driving test, state legislators d... by lttlrck on Sunday December 12, 2021 @01:03PM (#29531887)
Percentages are quite useless without the absolute numbers as a reference...
Re:Alarmed by Tesla’s self-driving test, state legislators d... by Pyramus on Sunday December 12, 2021 @12:49PM (#29531743)
So why doesn't Tesla share raw data with the public, or regulators? I cannot think of better PR for Tesla, and autonomous driving in general.
Re:Alarmed by Tesla’s self-driving test, state legislators d... by mcot2 on Sunday December 12, 2021 @01:03PM (#29531890)
They do and it is easily googled.

https://www.tesla.com/VehicleSafetyReport

Re:Alarmed by Tesla’s self-driving test, state legislators d... by kadoban on Sunday December 12, 2021 @01:14PM (#29532014)
That's only Autopilot and only gives one top line number per quarter, and comes after so much marketing fluff that it's pretty clear what department is generating it.
Re:Alarmed by Tesla’s self-driving test, state legislators d... by rscho on Sunday December 12, 2021 @12:43PM (#29531680)
Do your own research! :-D
Re:Alarmed by Tesla’s self-driving test, state legislators d... by rscho on Sunday December 12, 2021 @12:42PM (#29531670)
Yes, let's wait for that evidence to manifest itself instead! Smashing idea!