News for hackers. Stuff that matters.
Re:Could Cruise Be the Theranos of AI? by raylad on Saturday November 04, 2023 @09:39PM (#38147144)
I took a bunch of Cruise rides in SF when it was free, and I think I know what was going on.

The cars were (to me) clearly driving themselves. Their behavior was a bit too erratic for them to have been remotely controlled. But what did happen fairly often was that they would get confused and stop.

For example, my Cruise car needed to make a right turn and a van had parked on the corner, sticking out into the perpendicular street. The Cruise car went up to the corner and then stopped. It was apparently not programmed to go further out into the street and also wasn't programmed to be allowed to turn if it couldn't see around the corner.

We sat there for a couple of minutes, then I called Cruise support. They did not notice the problem themselves until I called.

I suggested that they inch the car forward because I had the above hypothesis about why it wouldn't turn, but instead I was told to wait. After a couple of minutes, the car inched back a few feet. Then, after a pause in which I assume they were transferring control back to the car's computer, it went to the corner again and stopped.

I told them again that they should move it forward, not back. But after another couple of minutes they moved it back again. Again it went forward and stopped on the corner. They tried this at least three times before accepting my suggestion. As soon as the car was able to see around the corner, it took off again, clearly under its own power.

So I don't think it's a case of remote drivers operating the cars, it's a case of remote drivers having to intervene when the cars stopped, and even in that case they try to make the cars do it on their own.

This is not Theranos behavior. This is debugging.

Re:Could Cruise Be the Theranos of AI? by toomuchtodo on Saturday November 04, 2023 @09:40PM (#38147150)
Tesla behavior without a driver and remote assistance?
Re:Could Cruise Be the Theranos of AI? by SamBam on Saturday November 04, 2023 @09:55PM (#38147243)
I don't see how this is in any way contacting the article. It seems to be confirming it.

The article just said that the cars needed a "remote human intervention" every few miles. Well, what you described was exactly that, an intervention.

The point is that if they need this kind of intervention every few miles, on average, than they're still not really at the level of driving themselves around town.

Re:Could Cruise Be the Theranos of AI? by raylad on Saturday November 04, 2023 @10:00PM (#38147284)
The implication of the article, and also some subsequent discussion here, was that there were remote drivers driving the cars around, and that the supposed self-driving was not really happening.

This is clearly not the case. When I was in Cruise cars they did all kinds of things that looked really difficult, like figuring out that a truck was stopped and double-parked and going around it, dodging cyclists that got in front of it, navigating around cars that were double parked on both sides of the street like a maze, etc.

Then, they would get stumped by unusual configurations like the one I recounted.

So whether they are 'at the level of driving themselves around town' or not depends on your definition. They drove around quite deftly although a bit erratically, and using sometimes very circuitous routes, but they definitely seemed to get all around town with only occasional glitches, none of which seemed at all unsafe (when I was in the car at least).

Re:Could Cruise Be the Theranos of AI? by quickthrower2 on Saturday November 04, 2023 @09:59PM (#38147279)
I would have just got out and walked at that point
Re:Could Cruise Be the Theranos of AI? by raylad on Saturday November 04, 2023 @10:00PM (#38147287)
I was quite far away from where I was going and the ride had just started a couple of blocks earlier.
Re:Could Cruise Be the Theranos of AI? by martinflack on Saturday November 04, 2023 @10:42PM (#38147531)
Or pushed.
Re:Could Cruise Be the Theranos of AI? by bryan_w on Saturday November 04, 2023 @11:47PM (#38147941)
It's interesting as from the videos I've seen, it seems like waymo doesn't even entertain the idea of allowing remote support staff that level of micromanagement to control a car.

It makes sense too, as you really don't wanna deal with the cell network to provide realtime updates to the dispatch. Better to just send a car out.

Heck it would even seem sensible to allow the customer support staff to update the model of the world that the car sees but still allowing it to travel autonomously.

Allowing direct remote control is wild

Re:Could Cruise Be the Theranos of AI? by rladd on Sunday November 05, 2023 @04:06PM (#38155642)
We don’t know that it’s direct remote control. It might be that they sent a command to it to back up or move forward and it figures out how to do that.
Re:Could Cruise Be the Theranos of AI? by bmitc on Sunday November 05, 2023 @11:55AM (#38152903)
> This is debugging.

On public roads. This shouldn't be allowed. If they want to do R&D, they need to build their own roads instead of endangering people going about their lives. None of these "automated" cars should be allowed on the roads, including Tesla cars with "self-driving" features enabled.

Re:Could Cruise Be the Theranos of AI? by raylad on Sunday November 05, 2023 @05:15PM (#38156207)
With requirements like that, there's no way such a product would ever get to the point of being usable.
Re:Could Cruise Be the Theranos of AI? by bmitc on Sunday November 05, 2023 @05:41PM (#38156426)
Then it's not a viable product or business.
Re:Could Cruise Be the Theranos of AI? by raylad on Sunday November 05, 2023 @10:40PM (#38158572)
We don't have those requirements on any other product, so it seems absurdly unnecessarily burdensome to just apply them to this particular product category.
Re:Could Cruise Be the Theranos of AI? by eig on Sunday November 05, 2023 @11:03PM (#38158706)
We do actually. In the car industry they have to test airbag systems in closed roads and special warehouses that the companies built themselves.
Re:Could Cruise Be the Theranos of AI? by bmitc on Sunday November 05, 2023 @11:16PM (#38158794)
> We don't have those requirements on any other product

Like what?

I mean, there are literally requirements even for these very products. It's just that they were given special permits to operate. California revoked these permits for Cruise. It is my opinion that they shouldn't have been given in the first place for such nascient and unproven technology. But the government and taxpayers, the latter unwittingly, have been swindled into dumping money into these companies.

Re:Could Cruise Be the Theranos of AI? by patrick451 on Wednesday November 08, 2023 @07:01PM (#38199058)
Yes we do. You don't get to to install experimental electrical outlets in people's homes so you can iterate on a design known to be deficient. They are certified first. Then sold. AVs should be no different.