News for hackers. Stuff that matters.
Re:Cruise co-founder and CEO Kyle Vogt resigns by minimaxir on Sunday November 19, 2023 @09:36PM (#38341523)
The situation at Cruise is so similar to OpenAI (political removal due to prioritizing success over safety) that the coincidental timing is almost contrived.

At least in this case, Vogt is doing a clear resignation on his own terms.

Re:Cruise co-founder and CEO Kyle Vogt resigns by babl-yc on Sunday November 19, 2023 @09:41PM (#38341561)
I don't see the situations similar at all.

Cruise is an extremely tough spot right now after its handling of the San Francisco accident, and it's nationwide pause of testing.

OpenAI has been extremely successful but is having strategic disagreements within its non-profit board.

Re:Cruise co-founder and CEO Kyle Vogt resigns by minimaxir on Sunday November 19, 2023 @09:47PM (#38341605)
Growing-too-fast ended up being the root cause in both cases.
Re:Cruise co-founder and CEO Kyle Vogt resigns by kuchenbecker on Sunday November 19, 2023 @09:56PM (#38341687)
What makes you come to that conclusion?
Re:Cruise co-founder and CEO Kyle Vogt resigns by ssnistfajen on Monday November 20, 2023 @12:51AM (#38343001)
Adding the words "integrity" and "honesty" to the dictionary of many tech companies could do them a lot of good, really.
Re:Cruise co-founder and CEO Kyle Vogt resigns by sillysaurusx on Sunday November 19, 2023 @10:17PM (#38341837)
Is this the SF accident you mean? I hadn’t heard of it, but this seems not at all worrisome:

> At approximately 9:30 p.m. on October 2, a human-driven vehicle struck a pedestrian while traveling in the lane immediately to the left of a Cruise AV. The initial impact was severe and launched the pedestrian directly in front of the AV. The AV then braked aggressively to minimize the impact. The driver of the other vehicle fled the scene, and at the request of the police the AV was kept in place.

Why was cruise under fire for this?

Re:Cruise co-founder and CEO Kyle Vogt resigns by ra7 on Sunday November 19, 2023 @10:23PM (#38341887)
Re:Cruise co-founder and CEO Kyle Vogt resigns by sillysaurusx on Sunday November 19, 2023 @10:31PM (#38341940)
Ah, thank you. Them not disclosing the full video from the outset was a mistake, but it’s surprising that it escalated so much. A human driver could’ve easily made the same mistake — pulling over isn’t uncommon after an accident, and there’s no way to detect someone under your car other than getting out, which is usually not very safe.

Oh well. Maybe next decade.

Re:Cruise co-founder and CEO Kyle Vogt resigns by friendlyasparag on Sunday November 19, 2023 @11:15PM (#38342180)
The escalation is perhaps less surprising given that it happened while Cruise had many (much smaller) traffic issues and CPUC was already significantly limiting Cruise. They were on very thin ice.
Re:Cruise co-founder and CEO Kyle Vogt resigns by ssnistfajen on Monday November 20, 2023 @12:54AM (#38343034)
Witholding the footage was more than just a mistake. If they are being this dishonest over something that wasn't even entirely their fault, what else could they be hiding?

And no, most human drivers would easily detect a human being stuck under their vehicle within seconds.

Re:Cruise co-founder and CEO Kyle Vogt resigns by SR2Z on Monday November 20, 2023 @01:06AM (#38343145)
A human driver would have probably been driving over the speed limit in this accident. All of these roads are 25 mph, and yet it's not uncommon to see traffic at 40 mph.

There's a good chance the woman would have been _killed outright_ if it hadn't been a Cruise. Are we willing to accept strange and inhuman failure modes if they overall lead to better safety than human drivers?

Re:Cruise co-founder and CEO Kyle Vogt resigns by ssnistfajen on Monday November 20, 2023 @01:21AM (#38343318)
Please just read on exactly what happened in the accident before making comments about irrelevant frill like the speed limit:

https://www.sfchronicle.com/bayarea/article/woman-run-autono...

Re:Cruise co-founder and CEO Kyle Vogt resigns by SR2Z on Monday November 20, 2023 @12:04PM (#38350597)
I am pretty familiar with the accident. The speed limit is not irrelevant; the question should not be "did the car behave as a perfect human driver would have?"

It should be "was the eventual outcome better than what a human driver would have achieved in the same situation?"

It's not actually clear that a human driver would have done better, and given that the human driver in this incident did a hit-and-run and still hasn't been caught, assuming that is... questionable.

The safety record of these cars is actually quite good when you consider the environment and times of day they operate in.

Re:Cruise co-founder and CEO Kyle Vogt resigns by nemothekid on Sunday November 19, 2023 @10:29PM (#38341930)
Weird - this leaves out the most worrying part of the incident; the woman was pinned under the cruise vehicle and ended up being dragged under the vehicle as the vehicle started moving again.

Furthermore, Cruise attempted to cover up the fact that the car dragged the woman. Now that I refresh myself on the details of the situation, it seems you have the "cleaned" PR statement that was pushed by Cruise and had omitted the above details

https://www.latimes.com/business/story/2023-10-26/cruise-rob...

Re:Cruise co-founder and CEO Kyle Vogt resigns by minimaxir on Sunday November 19, 2023 @10:21PM (#38341876)
The accident was one thing, but Cruise's response to regulators about the accident escalated the heat. https://www.reuters.com/business/autos-transportation/board-...
Re:Cruise co-founder and CEO Kyle Vogt resigns by sillysaurusx on Sunday November 19, 2023 @10:26PM (#38341911)
I don’t understand, but I suppose I’ll have to accept not understanding. The article vaguely gestures towards some sort of misrepresentation, but doesn’t elaborate. Thank you for pointing it out though.
Re:Cruise co-founder and CEO Kyle Vogt resigns by neuronerdgirl on Sunday November 19, 2023 @11:33PM (#38342290)
They cut the video they first showed the DMV of the accident to remove the last error made by the car, which was arguably the worst aspect of the accident as far as Cruise's default behavior failures. The DMV found out about the cut segment from the news.
Re:Cruise co-founder and CEO Kyle Vogt resigns by alain94040 on Sunday November 19, 2023 @10:23PM (#38341889)
You are missing what happened next, which Cruise tried to cover up.
Re:Cruise co-founder and CEO Kyle Vogt resigns by mcmcmc on Sunday November 19, 2023 @11:56PM (#38342432)
If you’ll excuse the tinfoil hat, the OpenAI disagreement could very well stem from a dangerous accident or near miss covered up by Altman that we just haven’t learned about yet since the board didn’t publicly state how he deceived them. And that would be pretty analogous to the Cruise situation.

Anyway Altman gives me the ick, serious lizard person vibes.

Re:Cruise co-founder and CEO Kyle Vogt resigns by Exoristos on Monday November 20, 2023 @12:18AM (#38342629)
"OpenAI ... dangerous accident." Like what, giving a freshman wrong dates for the Garfield presidency?
Re:Cruise co-founder and CEO Kyle Vogt resigns by mcmcmc on Monday November 20, 2023 @08:17PM (#38357482)
Like giving instructions on how to mix mustard gas to a potential school shooter. Or a manual on how to kill yourself to a depressed teen. Or a blueprint for how to build a bomb to a domestic terrorist.
Re:Cruise co-founder and CEO Kyle Vogt resigns by gumballindie on Sunday November 19, 2023 @09:57PM (#38341699)
In openai’s case it feels like perhaps safety is not the issue - a chatbot doesnt think and doesnt take over the world. But rater speed over quality. All chat bots released so far appeared less useful and less competent each passing month. As if there are serious product quality flaws and it takes a little bit of time to catch on.
Re:Cruise co-founder and CEO Kyle Vogt resigns by jsnell on Sunday November 19, 2023 @10:20PM (#38341863)
> political removal due to prioritizing success over safety

I don't really see the parallel.

It seems impossible to have success in self-driving without safety. Cars that are unsafe will literally kill people, which will then kill the program as seen with Uber.

The AI safety/success tradeoff seems far more nuanced. The threats are abstract, largely hypothetical, and safety seems to be directly in opposition with success. So it's easy to see why product-oriented people would feel justified in making a call to ignore or down-prioritize safety, in a way that nobody running a self-driving car program can afford to.