News for hackers. Stuff that matters.
Re:California suspends GM Cruise's autonomous vehicle deploy... by mips_avatar on Tuesday October 24, 2023 @03:09PM (#38003782)
The incident last month where that woman got dragged and pinned by the Cruise vehicle was pretty disconcerting. The initial collision wasn't the fault of the cruise vehicle (another vehicle hit her pushing her into the cruise vehicle and fled the scene), but the cruise vehicle then proceeded to try to "pull over" and just dragged this woman and rolled over her leg. Weird situation but definitely something made much much worse by not having a person in the loop once the incident occurred.
Re:California suspends GM Cruise's autonomous vehicle deploy... by pj_mukh on Tuesday October 24, 2023 @03:22PM (#38004005)
Did Cruise release the video, its not clear to me a human driver would be better (other than some textual descriptions of the event)? The (human) person who actually caused the crash is still at large, and the bay area (SF + Oakland) still continues to one of the municipalities with negligble traffic enforcement [1] and massively dangerous (human) driving behavior [2].

So the city and DMV focussing their efforts on this corner case driving systems seems like dereliction of duty on the City attorney's and DoT's part.

[1] https://sfstandard.com/2023/07/01/ask-the-standard-san-franc...

[2] https://www.youtube.com/watch?v=yUzc15BeAaE

Re:California suspends GM Cruise's autonomous vehicle deploy... by mips_avatar on Tuesday October 24, 2023 @03:26PM (#38004089)
This woman got dragged 20 feet by the car after the collision, and then the car rolled over her leg and left her pinned to the ground until the fire department came and removed the wheel to get her out. The cruise vehicle wasn't at fault for the initial accident, but the subsequent damage it caused was entirely the fault of the autonomous vehicle. A person would have stopped and helped the pedestrian.
Re:California suspends GM Cruise's autonomous vehicle deploy... by ironman1478 on Tuesday October 24, 2023 @03:37PM (#38004258)
The person who hit and run the woman in the first place shows this is obviously not true. You think they didn't notice?There was a muni bus who hit a pedestrian a few weeks ago and didn't even notice.
Re:California suspends GM Cruise's autonomous vehicle deploy... by bombcar on Tuesday October 24, 2023 @04:17PM (#38004854)
If the Cruise had hit and run it might have been better than parking on the woman's leg.
Re:California suspends GM Cruise's autonomous vehicle deploy... by ironman1478 on Tuesday October 24, 2023 @06:42PM (#38006709)
Except it didn't immediately do that. Cruise released a report today saying that the car actually drove 20 feet and dragged the woman. There is no simple answer as to what to do. It's simply difficult and acting like there are easy answers to this is unproductive and imo not in the spirit of hackernews.
Re:California suspends GM Cruise's autonomous vehicle deploy... by tempestn on Tuesday October 24, 2023 @07:46PM (#38007295)
It's difficult to program an autonomous vehicle to handle this correctly, sure. That doesn't mean an average human driver wouldn't have done better. Of course a human driver wouldn't just keep driving to pull over after hitting a pedestrian and not being able to see where they went.
Re:California suspends GM Cruise's autonomous vehicle deploy... by smileysteve on Tuesday October 24, 2023 @09:14PM (#38007949)
In some cultures, they have a custom to ensure whoever you hit dies so that you don't pay disability.

And the hit and run driver did just drive off

Re:California suspends GM Cruise's autonomous vehicle deploy... by imp0cat on Wednesday October 25, 2023 @01:36AM (#38009496)
Ah, the Chinese way. But it is not something we should be loking forward to.
Re:California suspends GM Cruise's autonomous vehicle deploy... by grogenaut on Tuesday October 24, 2023 @09:29PM (#38008047)
The person who hit and run commuted a felony. Cruise not providing evidence as asked and required by their testing agreement did similar. A muni bus and a car are different.

But the big issue is hiding / eliding the data.

Re:California suspends GM Cruise's autonomous vehicle deploy... by ironman1478 on Wednesday October 25, 2023 @10:35AM (#38013256)
I agree that hiding data is bad and the company should be punished. I was simply commenting on the fact that people frequently do not stop when running over pedestrians, which the parent comment claimed.
Re:California suspends GM Cruise's autonomous vehicle deploy... by pj_mukh on Tuesday October 24, 2023 @03:39PM (#38004282)
“The woman got dragged 20feet”

With respect this part is not clear. Only that the woman moved 20feet.

The DMV has not made clear whether she moved 20feet from the location of original Collision (ie with the human driver) or she was dragged 20feet as the cruise car kept driving. They’ve let the audience fill in the blanks and we’ve collectively come to the more exciting conclusion.

Re:California suspends GM Cruise's autonomous vehicle deploy... by darkerside on Tuesday October 24, 2023 @03:43PM (#38004353)
I'm pretty sure Cruise's statement worded this intentionally vaguely, and it's natural to assume they are trying to gloss over their responsibility in the most horrific part of the story.
Re:California suspends GM Cruise's autonomous vehicle deploy... by KennyBlanken on Tuesday October 24, 2023 @03:49PM (#38004422)
They had the balls to write "pulling the individual forward"
Re:California suspends GM Cruise's autonomous vehicle deploy... by skywhopper on Tuesday October 24, 2023 @03:51PM (#38004450)
The Cruise statement is what mentions "pulling the pedestrian forward 20 feet" so it's clear she was dragged for at least that distance.
Re:California suspends GM Cruise's autonomous vehicle deploy... by pj_mukh on Tuesday October 24, 2023 @04:04PM (#38004653)
It’s so painfully obvious to me that the solution here is to not having flying humans because of bad drivers that hit and run and not “actually let’s ban autonomous driving” (the city will inevitably come after Waymo next)
Re:California suspends GM Cruise's autonomous vehicle deploy... by jfim on Tuesday October 24, 2023 @04:37PM (#38005181)
Why not both? We shouldn't have flying humans, nor cars rolling over and dragging people.
Re:California suspends GM Cruise's autonomous vehicle deploy... by pj_mukh on Tuesday October 24, 2023 @05:18PM (#38005765)
The first problem is much harder to solve, the second one only happens because of the first.

The city elected to do the easy useless thing first and is patting themselves in the back (people are still gonna be flying due to shitty human drivers tomorrow). This is a problem.

Re:California suspends GM Cruise's autonomous vehicle deploy... by scarmig on Tuesday October 24, 2023 @08:07PM (#38007496)
It's also worthwhile to point out that, although in this case the bad human driver was the immediate cause of the accident, at scale this will happen with some frequency, either from bad human drivers, bugs in the software or hardware, or just weird situations. The entire point of AVs is that these can also be corrected at scale: people who make excuses for the failure are removing the paramount incentive to make AVs as near to perfect as possible.
Re:California suspends GM Cruise's autonomous vehicle deploy... by s1artibartfast on Tuesday October 24, 2023 @09:37PM (#38008086)
People get dragged to death under cars with unaware human drivers all the time.

I dont think you can definitively say a person would have stopped and helped.

Re:California suspends GM Cruise's autonomous vehicle deploy... by infamouscow on Tuesday October 24, 2023 @09:57PM (#38008244)
A person has the potential to do more than what a Cruise vehicle actually did in the situation.
Re:California suspends GM Cruise's autonomous vehicle deploy... by KennyBlanken on Tuesday October 24, 2023 @03:52PM (#38004465)
Pretty sure a human driver would have done more than what Cruise did, which was...nothing. They didn't even respond to anyone until firefighters covered the vehicle's sensors.

> Firefighters obstructed the sensors of the driverless car to alert the Cruise control center. He said representatives from Cruise responded to firefighters and “immediately disabled the car remotely.”

Re:California suspends GM Cruise's autonomous vehicle deploy... by DeRock on Tuesday October 24, 2023 @04:24PM (#38004968)
The human driver actually fled the scene. It was a hit and run.
Re:California suspends GM Cruise's autonomous vehicle deploy... by lokar on Tuesday October 24, 2023 @04:48PM (#38005330)
They lied to the DMV, that alone is enough to ban them.
Re:California suspends GM Cruise's autonomous vehicle deploy... by ToucanLoucan on Tuesday October 24, 2023 @04:59PM (#38005486)
Seriously! This! This times a thousand! I get that technology is cool and we love seeing stuff like autonomous cars (and to be clear, where I live, I would say they should be the default because holy shit can people not drive here) but like, this is just not okay. Cruise's cars have a well documented history of disrupting traffic, and additionally, they have been found to:

- Not be forthcoming with authorities on releasing information/video

- Be misrepresenting the performance of their vehicles to the authorities

This is just not acceptable for a company to be doing. This is not how we disrupt industries. You cannot "fake it till you make it" with road safety when building vehicles that traverse roads safely is your business' entire raison d'etre! That's just unacceptable, full stop.

And, add to it, Cruise has been given a direct and clear path to resuming operations, which essentially boils down to doing the thing they should've been doing already. Like come on! How much more benevolent can we ask a regulator to be in this scenario? One could argue, frankly, that they're being too kid gloves about a company lying to an organization who's primary goal is ensuring safety about safety!

Re:California suspends GM Cruise's autonomous vehicle deploy... by zestyping on Tuesday October 24, 2023 @06:04PM (#38006305)
What was the lie?
Re:California suspends GM Cruise's autonomous vehicle deploy... by fudged71 on Tuesday October 24, 2023 @06:19PM (#38006477)
Lie by omission
Re:California suspends GM Cruise's autonomous vehicle deploy... by oldgradstudent on Tuesday October 24, 2023 @07:16PM (#38007012)
They showed a video of the crash without the part where they dragged the pedestrian for 20 feet, claiming it was the full video of the incident.

The DMV was not aware of that until notified by another government agency that was investigating the incident.

Re:California suspends GM Cruise's autonomous vehicle deploy... by zestyping on Wednesday October 25, 2023 @06:39PM (#38019254)
Holy shit. Someone needs to get put in prison for this. Others get locked away for far less.
Re:California suspends GM Cruise's autonomous vehicle deploy... by phatskat on Tuesday October 24, 2023 @08:31PM (#38007676)
One problem is that the state taught them that it’s ok to lie, or at least that it’s ok to omit the full details.

During the certification process for these self-driving cars, incidents of the cars “misbehaving” (for lack of a better term) were supposed to be reported. However, if a human driver intervened, then it didn’t count as the car itself making a poor choice.

Example: self-driving car approaches an intersection clipping a reasonable speed and the light turns yellow. While a human driver would understand that it’s better to go through than to slam their brakes, the self-driving cat goes “yellow means red soon, stop now”. The human driver overrides and floors it through the intersection. Had the car stopped, that would’ve been a mark against the autonomous system. But since a human intervened, it doesn’t “count”.

This is a good watch on the state of self-driving cars and how policy makers have largely just said “eh, fuck it” in places like SF. https://youtu.be/pmGOjHi-7MM

[dead]
Re:California suspends GM Cruise's autonomous vehicle deploy... by mips_avatar on Tuesday October 24, 2023 @03:21PM (#38003995)
This woman got dragged 20 feet and then the car rolled over her leg and stopped. The fire department had to come and remove the wheel of the car to get it off her leg. I don't know of a single person who would have done that.
Re:California suspends GM Cruise's autonomous vehicle deploy... by pj_mukh on Tuesday October 24, 2023 @03:24PM (#38004046)
Dragged 20 feet after she was pinned under the car, or after being hit by the (human) driver? This part is not clear to me, and DMV never makes it clear either.
Re:California suspends GM Cruise's autonomous vehicle deploy... by ceejayoz on Tuesday October 24, 2023 @03:56PM (#38004532)
The DMV makes it perfectly clear.

> After coming to a complete stop, it then attempted to do a “pullover maneuver while the pedestrian was underneath the vehicle.”

Re:California suspends GM Cruise's autonomous vehicle deploy... by pj_mukh on Tuesday October 24, 2023 @03:59PM (#38004572)
For 20ft?
Re:California suspends GM Cruise's autonomous vehicle deploy... by dehugger on Tuesday October 24, 2023 @03:20PM (#38003963)
Stopped the vehicle, instead of continuing to drag them?
Re:California suspends GM Cruise's autonomous vehicle deploy... by mgiampapa on Tuesday October 24, 2023 @03:24PM (#38004053)
That's if they even saw the person was under them. My aunt got dragged by my grandfather as a child for a block and he at one point ran over my grandmother in a parking lot when she fell behind the car... this may say more about my grandfather than anything else, but average encompasses all kinds of drivers.
Re:California suspends GM Cruise's autonomous vehicle deploy... by Mavvie on Tuesday October 24, 2023 @03:22PM (#38004006)
I'm not too familiar with the details here, but probably hit the brakes and stop ASAP? If there could be someone under my car I wouldn't keep driving to "pull over safely".
Re:California suspends GM Cruise's autonomous vehicle deploy... by parshimers on Tuesday October 24, 2023 @03:21PM (#38003990)
stop and get out of the car because someone just got flung onto/underneath your car? or perhaps have enough situational awareness to see that someone is about to walk into oncoming traffic?
Re:California suspends GM Cruise's autonomous vehicle deploy... by twisteriffic on Tuesday October 24, 2023 @03:20PM (#38003962)
... Stopped?
Re:California suspends GM Cruise's autonomous vehicle deploy... by joe_the_user on Tuesday October 24, 2023 @03:51PM (#38004454)
Aside from the other comments, pulling over when you detect a collision is definitely not best human practice on an ordinary city street for a human driver. If you detect a collision, you stop the vehicle, access the situation and maybe pull over based on your assessment of the situation.

And this brings a question to me: How did they create, develop, this post-collision routine? Afaik, the overall program/system guiding a self-driving is some combination of trained neural-network routines and more standard robotic feedback loops. But "what to do after a collision" seems like one of those corner cases that neither programming approach would or could deal with so what development created this routine? It would have to be pure ad-hoc-ery and that suggests that in Cruise's approach to the last-mile/endless-corner-cases problem of self-driving cars is just that, a series of ad-hoc fixed. And this approach can neither be safe nor can it scale.

And further, I have to presume Cruise and the others have a bay of human pilots that are called-on to deal with difficult situations. Why didn't the "you've just had a collision" signal not pull a human? (maybe it did and not saying that is their problem but otherwise..) The main explanation I can think of is ... the car's routines are already calling pilots a lot and the team is working feverishly to reduce this. An ad-hoc pull-over routine is intended to reduce those calls back to the pilots. Admittedly this is speculation but if true it reinforces my conclusion above.

Re:California suspends GM Cruise's autonomous vehicle deploy... by FireBeyond on Tuesday October 24, 2023 @04:46PM (#38005293)
> And further, I have to presume Cruise and the others have a bay of human pilots that are called-on to deal with difficult situations.

And then there's a momentary thought of this, and then I think how bad/hard it would be. Sitting there in a "call center", "Ding!" and you're suddenly thrown in to a car mid-collision, needing to take instant surveying of the situation (like "there's someone partly trapped under the vehicle", "am I in the middle of an intersection/interstate", etc., et al.

Even getting past that I think such a job would play absolute hell on epi, norepi, dopamine, etc., response and those people would burn out, quickly (and I say that as someone who spends a lot of time waking up to alarm tones going off before jumping in an ambulance or fire engine...).

Re:California suspends GM Cruise's autonomous vehicle deploy... by eep_social on Tuesday October 24, 2023 @06:42PM (#38006706)
I heard that the way Waymo works is that the car actually presents solutions, multiple-choice style, to the call center operator. The operator assesses the situation and chooses one, and then the car executes it. I assume there’s also a “none of the above”’or some such which would flag someone to come on site.

The remote operator cannot manually operate the car under these circumstances and that is by design.

Re:California suspends GM Cruise's autonomous vehicle deploy... by andrewxdiamond on Tuesday October 24, 2023 @07:05PM (#38006911)
Sounds like a 911 operator but more technical and more data available
Re:California suspends GM Cruise's autonomous vehicle deploy... by guappa on Wednesday October 25, 2023 @05:08AM (#38010807)
And no possibility to dispatch.
Re:California suspends GM Cruise's autonomous vehicle deploy... by KKKKkkkk1 on Wednesday October 25, 2023 @01:35AM (#38009488)
By the time you're paged to handle the situation, the pedestrian is already trapped under the vehicle and you cannot see her because the car does not have an under-the-vehicle camera. So the only way you can handle this case is to rewind and review what happened before the collision and respond only then. Considering that the speed with which you react can be a matter of life and death, I don't see a satisfactory solution to this problem.
Re:California suspends GM Cruise's autonomous vehicle deploy... by askvictor on Wednesday October 25, 2023 @01:55AM (#38009598)
Why not have under-the-vehicle cameras and sensors?
Re:California suspends GM Cruise's autonomous vehicle deploy... by lobsterthief on Tuesday October 24, 2023 @07:39PM (#38007213)
> And this brings a question to me: How did they create, develop, this post-collision routine?

I’m just going to assume it’s a liability thing:

* Cruise gets in an accident and stays in the road, passenger gets out and gets hit. * Cruise gets in an accident and pulls to the curb, passenger can get out on the curb (and if they don’t, and get hit, Cruise can claim it pulled over).

I could see this decision being made (or reviewed by) legal. Which sounds like a truly awful way to build a product.

I agree with you on the adhockery as well. Sounds like it.

Re:California suspends GM Cruise's autonomous vehicle deploy... by Sephr on Tuesday October 24, 2023 @08:58PM (#38007853)
> * Cruise gets in an accident and stays in the road, passenger gets out and gets hit.

Waymo handles this by notifying riders when vehicles or cyclists are incoming near passenger exits.