News for hackers. Stuff that matters.
Re:Video of Tesla FSD almost hitting pedestrian receives DMC... by partido3619463 on Friday September 17, 2021 @11:44AM (#28566796)
Is the car turning right (after a no right turn sign) while it was supposed to be going straight according to nav?
Re:Video of Tesla FSD almost hitting pedestrian receives DMC... by stagger87 on Friday September 17, 2021 @11:50AM (#28566897)
Yes, and that's what makes it interesting in my mind. Where was the car going?
Re:Video of Tesla FSD almost hitting pedestrian receives DMC... by cmsj on Friday September 17, 2021 @11:57AM (#28566978)
It was hungry ;)
Re:Video of Tesla FSD almost hitting pedestrian receives DMC... by rvz on Friday September 17, 2021 @12:34PM (#28567520)
The car probably thought the pedestrian was an emergency vehicle, given the person was wearing a bright red coat and Teslas on FSD have a habit of crashing into them.

To Downvoters: Well it is actually true. [0] and just recently another crash involving an emergency vehicle. [1]

So there is a strange habit with Tesla FSD and red objects in its view. Given those incidents, care to explain why I am wrong?

[0] https://www.autoblog.com/2018/01/23/tesla-autopilot-crash-fi...

[1] https://www.reuters.com/business/autos-transportation/us-ide...

Re:Video of Tesla FSD almost hitting pedestrian receives DMC... by NickM on Friday September 17, 2021 @03:13PM (#28569741)
care to explain why I am wrong

Because even in cases where cars have hit emergency vehicles, it's because the software didn't see the vehicles at all and just continued driving straight in its lane. Whatever flaws the Tesla vision system may have, the idea that it is programmed to deliberately seek out and crash into emergency vehicles seems pretty far-fetched (much less that it would mistake a person wearing a red coat for an emergency vehicle and therefore attempt to crash into it); I assume this is why people are downvoting you.

Re:Video of Tesla FSD almost hitting pedestrian receives DMC... by mcjshciejebcu on Friday September 17, 2021 @01:02PM (#28567870)
The no right turn sign appears to be for the other side of the street, since at the intersection itself, there's a one way sign indicating right turns are possible, and no do not enter signs.
Re:Video of Tesla FSD almost hitting pedestrian receives DMC... by comeonseriously on Friday September 17, 2021 @11:53AM (#28566936)
Exactly! What the heck spooked the "AI"?
Re:Video of Tesla FSD almost hitting pedestrian receives DMC... by pjc50 on Friday September 17, 2021 @11:57AM (#28566974)
Some of the discourse suggested that previously it had had problems with the pillars for the monorail running down the median, and the owner/driver was trying it again to see if it had improved.

One of the big limits of this kind of AI is that it does not provide human-legible explanations for its actions. You cannot put it in front of a tribunal.

Re:Video of Tesla FSD almost hitting pedestrian receives DMC... by emn13 on Friday September 17, 2021 @12:11PM (#28567180)
Actually, all kinds of data pertaining to the decision making process is recorded (at least for some of Tesla's competitors, not sure about Tesla), and in great detail. The data is specifically designed to make the AI driver "debuggable", i.e. it includes all kinds of details, intermediate representations, etc that an engineer would need to improve a poor decision, and thus certainly to understand a poor decision.

Whether that kind of logging is always on or was specifically on here, I don't know, but I'd expect Tesla can analyze why this happened: the car does have the ability to explain itself; it's just that owners and drivers do not have access to that explanation.

Re:Video of Tesla FSD almost hitting pedestrian receives DMC... by mrguyorama on Friday September 17, 2021 @12:27PM (#28567408)
You can log and debug the inputs going into the black box, and the outputs, but how do you debug inside the black box?
Re:Video of Tesla FSD almost hitting pedestrian receives DMC... by emn13 on Friday September 17, 2021 @01:43PM (#28568500)
The box isn't as black as you might think; they're not training some monolithic AI model, there are separated systems involved. Also, the models aren't entirely freeform; i.e. engineers embed knowledge of how the world is structured into those networks.

They can use those intermediates to project a kind of thought process others can look at - and you've probably seen videos and images of that kind of thing too; i.e. a rendered version of the 3d intermediate world it's perceived, enhanced with labels, enhanced with motion vectors, cut into objects, classified by type of surface, perhaps even including projections of likely future intent of the various actors, etc.

Sure, you can't fully understand how each individual perceptron contributes to the whole, but you can understand why the car suddenly veered right, what it's planned route was, what it thought other traffic participants were about to do, which obstacles it saw, whether it noticed the pedestrians, which traffic rules it was aware of, whether it noticed the traffic lights (and which ones) and how much time it thought remained etc.

...at least, sometimes; I don't know anybody working at Tesla specifically.

Here, for example waymo has a public PR piece kind of highlighting all the kind of stuff they can extract from the black box: https://blog.waymo.com/2021/08/MostExperiencedUrbanDriver.ht...

And while they emphasize their lidar tech, I bet Tesla's team, while using different sensors, also has somewhat similarly complex - and inspectable - intermediate representations.

Re:Video of Tesla FSD almost hitting pedestrian receives DMC... by mcguire on Friday September 17, 2021 @02:50PM (#28569436)
"Also, the models aren't entirely freeform; i.e. engineers embed knowledge of how the world is structured into those networks."

In the days when Sussman was a novice, Minsky once came to him as he sat hacking at the PDP-6.

"What are you doing?", asked Minsky.

"I am training a randomly wired neural net to play Tic-tac-toe", Sussman replied.

"Why is the net wired randomly?", asked Minsky.

"I do not want it to have any preconceptions of how to play", Sussman said.

Minsky then shut his eyes.

"Why do you close your eyes?" Sussman asked his teacher.

"So that the room will be empty."

At that moment, Sussman was enlightened.

(https://news.ycombinator.com/item?id=10970937)

IIRC, in the incident where the Tesla [Edit: Uber self driving car] collided with a pedestrian pushing a bicycle in Arizona, the Tesla repeatedly switched between calling the input a pedestrian and a bicycle. And took no evasive actions while it was trying to decide.

Re:Video of Tesla FSD almost hitting pedestrian receives DMC... by mrguyorama on Friday September 17, 2021 @03:18PM (#28569806)
>the incident where the Tesla collided with a pedestrian pushing a bicycle in Arizona

That was Uber's self driving car program. Notably, the SUV they were using has had pedestrian detecting auto-stopping for several years, though I'm sure it's not 100%

Re:Video of Tesla FSD almost hitting pedestrian receives DMC... by mcguire on Friday September 17, 2021 @04:23PM (#28570476)
Sorry, Uber, you're right! Whoops!
Re:Video of Tesla FSD almost hitting pedestrian receives DMC... by mcguire on Friday September 17, 2021 @02:44PM (#28569355)
Does Tesla use a neural network for sensing and scene recognition/the observe-orient steps? For parts of the decide-act steps?

That particular kind of black box is very black; it has hundreds of thousands to millions of inputs feeding a hyperdimensional statistical model.

Re:Video of Tesla FSD almost hitting pedestrian receives DMC... by mjevans on Friday September 17, 2021 @12:01PM (#28567029)
It takes a jury of peers to interrogate properly.

So, the same / similar data fed to the same / similar algorithms and the state of the code examined by qualified experts (programmers).

Re:Video of Tesla FSD almost hitting pedestrian receives DMC... by mzs on Friday September 17, 2021 @12:14PM (#28567220)
I did not see a no right turn sign.

ed: modeless 1 hour ago

>That sign applies only to the lanes to the left of the pillars. It is legal to turn right there from the right lane. I've done it myself. Yes, it is confusing.

Re:Video of Tesla FSD almost hitting pedestrian receives DMC... by CameronNemo on Friday September 17, 2021 @12:26PM (#28567400)
Look again. It is on one of the pillars in the median, shortly before the turn.
Re:Video of Tesla FSD almost hitting pedestrian receives DMC... by modeless on Friday September 17, 2021 @12:53PM (#28567746)
That sign applies only to the lanes to the left of the pillars. It is legal to turn right there from the right lane. I've done it myself. Yes, it is confusing.
Re:Video of Tesla FSD almost hitting pedestrian receives DMC... by RandallBrown on Friday September 17, 2021 @12:59PM (#28567824)
It's not an illegal right. That sign is for the left lane.