News for hackers. Stuff that matters.
Re:7.1M miles, 3 minor injuries: Waymo's safety data looks good by UncleMeat on Thursday December 21, 2023 @01:47PM (#38724890)
Ordinary neurotypical drivers act "unexpectedly" on the road all the time. I know that I would brake if I saw a downed branch. And people do much much much more. Suddenly change lanes on the highway with no signaling? Check. Brake suddenly because you almost missed your turn without looking to see if anybody was following close behind? Check. Drive over non-lane portions of the road because you were late seeing your highway exit? Check. Swerve suddenly because you dropped your phone between the seats while texting? Check.

I've seen people reverse up a highway onramp.

Re:7.1M miles, 3 minor injuries: Waymo's safety data looks good by wddkcs on Thursday December 21, 2023 @03:19PM (#38726289)
I think both points are true- people act unexpectedly all the time, so much so that we've come to expect the unexpected, by the sophistication of our theory of mind. I live in a city where erratic driving is commonplace, but that's in relation to the legal norms. New local norms become accepted, which you can anticipate once you adapt. Some of these 'norms' are handy time savers, others are incredibly dangerous and result in frequent accidents, but persist anyway.

How will AI drivers navigate these 'cultural' differences? Will they insist on following the letter of the law (presumably, for liability) or will they adapt to local practices and potentially lower their overall collision rate with humans driving poorly. Interesting near term question.

Re:7.1M miles, 3 minor injuries: Waymo's safety data looks good by droopyEyelids on Thursday December 21, 2023 @09:30PM (#38730216)
You’re being selectively reductive.

The unexpected is, by definition, what was not predicted.

Re:7.1M miles, 3 minor injuries: Waymo's safety data looks good by pastage on Friday December 22, 2023 @01:47AM (#38731621)
The point is unexpected is supposed to be in norm, self driving cars can not tell what a norm is. The idiom is not about the word unexpected, more about the relatioship between chaos and order
Re:7.1M miles, 3 minor injuries: Waymo's safety data looks good by jjav on Thursday December 21, 2023 @06:33PM (#38728695)
> Ordinary neurotypical drivers act "unexpectedly" on the road all the time.

"all the time" means it is not unexpected. Humans do mistakes and omissions that you've subconsciously learned that humans do, so you can adjust to deal with that.

The difficulty with AI is that it behaves like a completely alien being, making errors that are alien and unpredictable to a human driver.

Re:7.1M miles, 3 minor injuries: Waymo's safety data looks good by richbell on Friday December 22, 2023 @06:34AM (#38733206)
> "all the time" means it is not unexpected. Humans do mistakes and omissions that you've subconsciously learned that humans do, so you can adjust to deal with that.

For example, just because someone has their turn signal on and is slowing down doesn't mean they're going to turn.

Re:7.1M miles, 3 minor injuries: Waymo's safety data looks good by true_religion on Friday December 22, 2023 @07:48AM (#38733604)
Alien and unpredictable until we have enough experience with them to know their edge cases.

From my experience with LLMs, AIs even when called to be creative are fairly consistent, even if at first they seem to be producing output that’s more creative than human norms.

Re:7.1M miles, 3 minor injuries: Waymo's safety data looks good by bumby on Friday December 22, 2023 @08:43AM (#38734044)
Because of the number of interfaces in the environment, there are a near infinite number of edge cases. The mail point is that because we evolved a theory of mind with humans, we can more reliably narrow that number of edge cases with human drivers without having to experience it first. Having an AV learn those edge cases bears some risk, and that risk may be carried by unwilling members of society.
Re:7.1M miles, 3 minor injuries: Waymo's safety data looks good by shadowgovt on Friday December 22, 2023 @12:17PM (#38736289)
Unwilling members of society are already carrying the risk of every nascent driver entering the road for the first time solo and every aging driver who hasn't yet had the accident that loses them their license.
Re:7.1M miles, 3 minor injuries: Waymo's safety data looks good by bumby on Friday December 22, 2023 @12:47PM (#38736626)
That's the point of the risk part of the comment. Because we've evolved to have a theory-of-mind with other humans, we can at least know or intuit some of that risk. That's different than accepting a black-box risk. The whole point of the trust part of the comment is that, in order to build trust, we need to have risk-informed decisions.
Re:7.1M miles, 3 minor injuries: Waymo's safety data looks good by UncleMeat on Saturday December 23, 2023 @09:36AM (#38744486)
Each individual behavior is indeed unexpected. When I go through an intersection I don't expect that somebody blows through a red light and t-bones me. But that does happen.

Perhaps a self driving car's unexpected behavior is on the "too defensive" side while human drivers are on the "suddenly do something wildly dangerous" but this is easier to account for as a driver rather than more difficult to account for.

Re:7.1M miles, 3 minor injuries: Waymo's safety data looks good by alehlopeh on Sunday December 24, 2023 @04:14PM (#38756919)
You don’t expect that someone will blow through a red light, but you expect that they could, and so you look both ways before you accelerate if you’re the first one waiting when the light turns green.

You wouldn’t expect someone to suddenly accelerate from a stop while they have a red light, so you don’t typically look both ways when driving through a light that has already been green for a while when there are cars on either side waiting.

I’m not saying Waymo cars do that; just an example of expected unexpected vs unexpected unexpected behavior.

Re:7.1M miles, 3 minor injuries: Waymo's safety data looks good by patmorgan23 on Thursday December 21, 2023 @07:11PM (#38729048)
The question is how different is the set of unexpected things humans do from the set of unexpected things waymo/autopilots do/will do.

Also sometimes I can intuit that the driver in front of me is probably going to do something dumb because of other minor things I've observed about their driving style.

Re:7.1M miles, 3 minor injuries: Waymo's safety data looks good by cyanydeez on Friday December 22, 2023 @11:59AM (#38736074)
the swarm doesn't though. I can rely on most drivers to avoid black swan events
Re:7.1M miles, 3 minor injuries: Waymo's safety data looks good by shadowgovt on Friday December 22, 2023 @12:10PM (#38736215)
But unlike an automated vehicle, when a black swan event does occur in a human driver you can't disassemble their thought process, correct it, and apply that correction to all other human drivers unfortunately.
Re:7.1M miles, 3 minor injuries: Waymo's safety data looks good by cyanydeez on Friday December 22, 2023 @01:27PM (#38736964)
yes, but we can hold that person accountable.

are we going to jail some programmer because the missed a corner case and created a fatality.

ultimately what s problematic is what capitalism usually does which is externalize the costs via techno washing.

Re:7.1M miles, 3 minor injuries: Waymo's safety data looks good by bumby on Friday December 22, 2023 @03:19PM (#38738185)
Maybe not the programmer (unless we get to position where they are licensed like other engineering disciplines), but we can hold a company liable. Some companies have already stated they will accept "full liability" [1]. That reference is nearly a decade old, and some companies have admitted AV is a much harder problem than they initially anticipated, so I'm wondering if they would walk that statement back now.

[1] https://www.motortrend.com/news/volvo-will-accept-full-liabi...

Re:7.1M miles, 3 minor injuries: Waymo's safety data looks good by cyanydeez on Friday December 22, 2023 @05:31PM (#38739382)
right, but as far as I know, non of the current self driving testbeds are actively insured and liable. maybe it's under reported, but if you used FEMA value of life, you should have seen multiple million dollar payouts.