Re:This car is on Autopilot. What happens next?
by mikestew on Wednesday June 13, 2018 @12:00PM
(#17304294)
So the quote at the end is Tesla's "you're holding it wrong" moment, eh? It reminds me of stubborn developers that blow off bad UI design with "they're not supposed to do that". Well, fact of the matter is, users do do that, so account for it. Fact of the matter is, Tesla, your advertising gives users the impression that they can practically take a nap with Autopilot on (because it has the hardware for fully-automated driving, amirite?), so don't be pulling out the fine print about proper use of Autopilot.
To a more general point, when driving a car I should not have to ask, "is it going to work this time?" I hit the brake pedal, I have a high degree of confidence that the car will scrub off speed. I hit the gas, I don't worry that it will go (except in our old VW). I set Autopilot, I expect that it won't plow into the back of car in front of it. Whoops, scratch that last one. Instead, I'll constantly be wondering if it's going to do its job.
Re:This car is on Autopilot. What happens next?
by notlob on Wednesday June 13, 2018 @01:35PM
(#17305273)
In risk management for the medical devices I’ve worked on, we account for users and patients not following instructions during the design process. “You’re holding it wrong” is literally something we account for. From my perspective Tesla has been baffling, especially so considering the highly involved CEO is aware that people use his company’s product contra to the instructions for use.
Re:This car is on Autopilot. What happens next?
by dpark on Wednesday June 13, 2018 @02:16PM
(#17305675)
> Well, fact of the matter is, users do do that, so account for it.
Of course they do that. The functionality is completely useless if you still have to fully engage with driving the car. Cruise control is useful for resting the driver’s leg. This doesn’t require a reduction in attention. Partial automation’s benefit comes specifically from relieving the demand for attention. To turn around and say that you still have to be fully attentive and in full control is to say that the automation is entirely useless.
Re:This car is on Autopilot. What happens next?
by dm319 on Wednesday June 13, 2018 @11:54AM
(#17304248)
Tesla keep repeating the 'if you use it as designed you won't have an issue'.
But they need to be honest with themselves - in the public's mindshare these are 'self-driving' vehicles, and there's no doubt that Tesla has benefited from the idea that Tesla cars have this technology and the corresponding image of their cars being a new generation of vehicle.
It isn't helped (or it is, depending on your perspective) by naming the system 'auto-pilot', which implies to the lay person an automatic system.
Really this isn't much more than lane-assist, adaptive cruise control and emergency braking, terms which do not imply you can delegate control to a computer.
Re:This car is on Autopilot. What happens next?
by vinceguidry on Wednesday June 13, 2018 @01:05PM
(#17304967)
The problem isn't that Tesla isn't being reasonable, the problem is that the public doesn't have the attention span to try to understand a more nuanced picture. People just don't want to hear that they're still driving the car, they want to deal with cars that drive themselves, whether to say it's a great thing or to say it's a scourge.
There's really only so far Tesla can go in its attempts to educate the public. In fact, they've been strenuously stating, over and over again, that these aren't self-driving cars. Autopilot as a name for the technology is in line with how it's used and expected to perform in commercial airplanes. You still have to know how to fly the plane and you still need to stay vigilant.
Re:This car is on Autopilot. What happens next?
by mikestew on Wednesday June 13, 2018 @01:23PM
(#17305162)
There's really only so far Tesla can go in its attempts to educate the public.
Thankfully, they have a long way to go before they reach the limits of how far "only so far" is.
In fact, they've been strenuously stating, over and over again, that these aren't self-driving cars.
The first link I came to when searching "tesla fully automated hardware" was this: https://www.tesla.com/blog/all-tesla-cars-being-produced-now... I read the page twice, and didn't see a single outright statement that the cars aren't self-driving. Oh, I could infer it, but Tesla never came right out and said it, let alone "strenuously".
EDIT: because my search string was a bit loaded, in that I knew it would find the link I'm looking for, let's be more fair with:
"tesla fully automated driving" - the link above is the first listing
"tesla autonomous driving" - the link above is the 2nd link.
In summary, should I care to know more about Teslas and their autonomous driving abilities, I will likely be led to a page that never mentions that these cars can't drive themselves, but strongly implies that they can.
Re:This car is on Autopilot. What happens next?
by jcranmer on Wednesday June 13, 2018 @02:10PM
(#17305618)
> In fact, they've been strenuously stating, over and over again, that these aren't self-driving cars.
They only state that in response to "Tesla car involved in crash"-style reports. Otherwise, the messaging they send out is "our cars are basically self-driving." At best, Tesla is guilty of sending out severely mixed messaging, and at worst, they're lying to people and claiming that it's not lying because there is a footnote that's telling the truth (that is designed so that no one will see it).
Re:This car is on Autopilot. What happens next?
by compcoffee on Wednesday June 13, 2018 @02:01PM
(#17305533)
>In fact, they've been strenuously stating, over and over again, that these aren't self-driving cars.
The Tesla fans keep repeating this, but it flies in the face of the description of Autopilot on Tesla's website. I can't tell if they are being deliberately ignorant, or what. But the fact that Tesla claims you can press a button and summon your car, at least in my mind, says "cars that drive themselves".
Re:This car is on Autopilot. What happens next?
by compcoffee on Wednesday June 13, 2018 @01:24PM
(#17305177)
>They just really shouldn't have called this autopilot. It creates all the wrong expectations.
Have you read the marketing on the website?
All you will need to do is get in and tell your car where to go. If you don’t say anything, the car will look at your calendar and take you there as the assumed destination or just home if nothing is on the calendar. Your Tesla will figure out the optimal route, navigate urban streets (even without lane markings), manage complex intersections with traffic lights, stop signs and roundabouts, and handle densely packed freeways with cars moving at high speed. When you arrive at your destination, simply step out at the entrance and your car will enter park seek mode, automatically search for a spot and park itself. A tap on your phone summons it back to you.
So it's not like this is a case of "it's called something that it isn't really", or mismanaged expectations. Tesla is explicitly stating the car drives itself. They still claim it's "Autopilot". Is what they are selling anything close to what is described there?
Re:This car is on Autopilot. What happens next?
by dpark on Wednesday June 13, 2018 @02:05PM
(#17305580)
That’s their pitch for future Autopilot functionality, I believe. They (probably intentionally) make future claims in a way that they can be interpreted as current functionality.
Re:This car is on Autopilot. What happens next?
by andrewtbham on Wednesday June 13, 2018 @01:48PM
(#17305404)
The name is technically correct. Autopilot on planes is an assistive technology. The problem is there is a common misconception among the general public that it's beyond assistance and is partial automation.
Furthermore, even if you're totally aware it's only assistance, there is a tendency to be more easily distracted. That's what a google study found like 5 years ago.
I am a huge Tesla fanboy, and stock holder. But be careful.. if you are struggling to remain vigilant... turn off autopilot.
Re:This car is on Autopilot. What happens next?
by crysin on Wednesday June 13, 2018 @01:58PM
(#17305507)
I think the person you're responding to was saying there's a misconception of what autopilot means in general. People think autopilot is some form of automation for planes but its not. Though I could be reading the person's comment wrong.
Re:This car is on Autopilot. What happens next?
by andrewtbham on Wednesday June 13, 2018 @03:11PM
(#17306095)
Yes, exactly. If you ask an average person what auto pilot does on a plane (with no mention of Tesla). They say it's when a plane flies itself. That is wrong. It's an assistive technology.
Re:This car is on Autopilot. What happens next?
by dsabanin on Wednesday June 13, 2018 @01:51PM
(#17305438)
Autopilot on planes does not deal with obstacles _at all_. It functions in perfectly controlled environment while being guided by multiple monitoring systems controlled by humans (ie. ATC towers).
The metaphor of autopilot for cars just does not work and was used in error.
Re:This car is on Autopilot. What happens next?
by Animats on Wednesday June 13, 2018 @01:07PM
(#17304993)
That surprised even me. I would have expected Tesla's vision system to recognize a car rear end and stop. That's the one thing it's supposed to do well.
Re:This car is on Autopilot. What happens next?
by mikestew on Wednesday June 13, 2018 @01:15PM
(#17305086)
Based on the most recent NTSB report, I wouldn't have been surprised (in fact, I almost expected it since the video is setting us up for something) if the car sped up. "Woo hoo! Slow poke got out of my way, increase to Ludicrous speed!"
Re:This car is on Autopilot. What happens next?
by secabeen on Wednesday June 13, 2018 @01:12PM
(#17305057)
This is the stationary vehicle in traffic lanes problem. See any of the discussions from earlier this week or last on why detecting stationary objects in traffic lanes is hard.
Re:This car is on Autopilot. What happens next?
by planteen on Wednesday June 13, 2018 @01:38PM
(#17305307)
I'd assume when you are going 40 mph and hit the brakes as hard as you can that you'd hear squealing and leave skid marks? Anyone have a guess for how hard the brakes were applied?
Re:This car is on Autopilot. What happens next?
by marschr on Wednesday June 13, 2018 @06:04PM
(#17307388)
Looking at the Tesla's suspension, it looks like it gradually applied the brakes.. The accel forces would be way stronger if the car punched the brakes.
Btw, it's probably designed to respond to a confidence level curve and apply the brakes accordingly.
Not to mention that, if the dummy car is NOT made out of metal (or at least contain some), the ~70GHz radar would have trouble detecting it.
Re:This car is on Autopilot. What happens next?
by sounds on Wednesday June 13, 2018 @01:38PM
(#17305305)
I think this article is useful because, in addition to the BBC being a pretty big media outlet, this shows that basically anyone can create the hazardous conditions.
Re:This car is on Autopilot. What happens next?
by jackhack on Wednesday June 13, 2018 @01:07PM
(#17304990)
What happens next? Nothing, until somebody important dies, at which point lawyers for the family will swoop in to feed on the company involved. Meanwhile, lawmakers will preen and posture and create eventual regulations and restrictions on the concept. The media will portray this as an exaggerated risk to everyone on the planet.
I am not passing judgement, merely making an observation/prediction.
Re:This car is on Autopilot. What happens next?
by dsfyu404ed on Wednesday June 13, 2018 @01:25PM
(#17305186)
The vast majority of vehicles will have reflective surfaces of particular colors and sizes in a particular range of locations in accordance with applicable law and a reflective plate with letters and numbers. Of the ones that don't most of them will have underside guards, hitch receivers, or one of several common commercial vehicle body types.
Detecting these patterns is easier than pedestrian and bike detection because the problem space is so much more bounded. It's hard to give them a pass for not doing it.
Re:This car is on Autopilot. What happens next?
by HeyLaughingBoy on Wednesday June 13, 2018 @04:08PM
(#17306495)
What difference does that make? There are many road obstacles besides cars. Last Saturday, in broad daylight (3PM), I had a deer run out in front of me on a freeway onramp, then stop in the middle of the road when she realized her fawn wasn't following her.
I, and the other drivers behind me, avoided hitting the deer because we're used to dealing with them. Should we give Tesla a pass if it hits one because detecting a stationary deer is harder than detecting a stationary car?
Re:This car is on Autopilot. What happens next?
by Osiris on Wednesday June 13, 2018 @02:03PM
(#17305559)
It seems like it would actually be "better" to indicate (audio and/or visual alert) to the driver actions that should be taken rather than taking them automatically.
1. Indicate to the driver that they drifting out of their lane
2. Warn about possible slow or stationary object ahead
If the driver knows that car won't take action on it's own, but will help them but telling them about things that can't see (or when they are distracted), then we wouldn't be blaming Tesla but the driver.
Re:This car is on Autopilot. What happens next?
by tinbad on Wednesday June 13, 2018 @02:15PM
(#17305661)
It always infuriated me that Tesla called the same tech (Mobileye) "Autopilot", while Audi (and other OEMs) have used the exact same tech but didn't go as far to call even semi-autonomous driving. Audi & Mercedes systems do exactly what you mentioned, the tech is used to warn the driver (audio/visually but even with vibrations in seat and steering wheel) of impeding danger. It's a good case of Silicon Valley's "break stuff fast, iterate quickly" mindset that may be acceptable if it's the latest photo share app, but absolutely despicable business practice when human lives are at stake.
Disclosure: I currently own an Audi vehicle with this technology that has been available since 2009.
Re:This car is on Autopilot. What happens next?
by eckmLJE on Wednesday June 13, 2018 @12:53PM
(#17304838)
I don't actually understand how Tesla autopilot detects cars ahead of it--but does this experiment properly simulate the stationary car, e.g. is it made of metal (and is that the material that Tesla autopilot is designed to detect)?
Re:This car is on Autopilot. What happens next?
by Splines on Wednesday June 13, 2018 @01:17PM
(#17305117)
At the end of the day it doesn't matter if this experiment properly simulated a stationary car - unless you could argue that the Tesla was prescient enough to understand it was going to run into a car dummy. Any kind of road obstacle, be it construction, debris, or a wall, isn't necessarily going to look like a car.
Re:This car is on Autopilot. What happens next?
by dmode on Wednesday June 13, 2018 @12:58PM
(#17304884)
No, the TL;DR is that all semi autonomous systems ignore stationary object as it is difficult to precisely measure if the object is in the lane. Highways have a ton of stationary object such as overhead signs, debris, construction stuff. Trying to accurately process all of these items will lead to frequent wrongful hard braking leading to rear ended accidents. That's why they are ignored.
Re:This car is on Autopilot. What happens next?
by diggernet on Wednesday June 13, 2018 @06:48PM
(#17307676)
And yet, Subaru EyeSight can detect and react to stationary objects without any of the problems you describe. Do they have some magic technology unavailable to Tesla?
Re:This car is on Autopilot. What happens next?
by nmeofthestate on Wednesday June 13, 2018 @12:54PM
(#17304843)
Because it didn't have the space, and it apparently is not programmed to steer round obstacles (a much more tricky job to tell where you can steer to as opposed to staying in between what look like lane markings).
Re:This car is on Autopilot. What happens next?
by ovao on Wednesday June 13, 2018 @02:49PM
(#17305938)
The driver in front also knew about the stationary ‘car’ well ahead of time and was instructed to avoid it by merging into another lane. An actual human driver in a real scenario may perform better than the Tesla, as well as the Tesla or worse than the Tesla — it just depends.
Re:This car is on Autopilot. What happens next?
by nmeofthestate on Tuesday June 19, 2018 @11:21AM
(#17347478)
Tesla's algorithm is "try to slow down, but nevertheless plow into stuff if that doesn't work". It is demonstrably worse than the human algorithm of "slow down, but also steer to avoid obstacles". I can't see how you can objectively say they're equally good.
Re:This car is on Autopilot. What happens next?
by JoeAltmaier on Tuesday June 19, 2018 @11:25AM
(#17347529)
Do we want a car deciding whether to leave the lane? Leave the road? It could do more harm than good. We'll have to decide this, soon. By law hopefully - some standards for auto-drive and what it's allowed to do.
Because if we don't, software will have to code up the 'trolly car problem' solution, starting now. Hit the school bus ahead? or the guy walking beside the road? or the brick wall (and kill its passenger)? There's no good (universally defendable) solution.
Re:This car is on Autopilot. What happens next?
by GreaterFool on Wednesday June 13, 2018 @05:29PM
(#17307129)
I'd argue that the car in front is at fault changing lanes at last possible second. This may or may not leave the drivers behind enough time to follow suit. Clearly this is a manufactured situation but in order to draw conclusions I'd like to see tests when unsuspecting human driers follows the leading car.
I re-watched the video and it really doesn't look like the Tesla is breaking. The video says "unable to break in time". This to me sounds misleading. It is not clear whether Tesla tried to break but the distance was too short or it didn't attempt to break. Which leads me to conclude there's an agenda here.
Re:This car is on Autopilot. What happens next?
by ovao on Wednesday June 13, 2018 @05:37PM
(#17307190)
It can't be deduced from the footage alone whether the Model S is braking or not, but it's clear that it decelerates and stops after it impacts the dummy car.
In the U.S. at least, it's highly unlikely that the driver in front would be found legally at fault in a similar accident. In most cases of rear-end collisions, the driver who impacts the rear of the car will be found at fault.
Re:This car is on Autopilot. What happens next?
by lutorm on Wednesday June 13, 2018 @02:35PM
(#17305839)
The car in front also had unobstructed vision. If you tailgate a car that blocks your view ahead, a human driver is just as susceptible to being surprised like this.
To a more general point, when driving a car I should not have to ask, "is it going to work this time?" I hit the brake pedal, I have a high degree of confidence that the car will scrub off speed. I hit the gas, I don't worry that it will go (except in our old VW). I set Autopilot, I expect that it won't plow into the back of car in front of it. Whoops, scratch that last one. Instead, I'll constantly be wondering if it's going to do its job.
Of course they do that. The functionality is completely useless if you still have to fully engage with driving the car. Cruise control is useful for resting the driver’s leg. This doesn’t require a reduction in attention. Partial automation’s benefit comes specifically from relieving the demand for attention. To turn around and say that you still have to be fully attentive and in full control is to say that the automation is entirely useless.
But they need to be honest with themselves - in the public's mindshare these are 'self-driving' vehicles, and there's no doubt that Tesla has benefited from the idea that Tesla cars have this technology and the corresponding image of their cars being a new generation of vehicle.
It isn't helped (or it is, depending on your perspective) by naming the system 'auto-pilot', which implies to the lay person an automatic system.
Really this isn't much more than lane-assist, adaptive cruise control and emergency braking, terms which do not imply you can delegate control to a computer.
There's really only so far Tesla can go in its attempts to educate the public. In fact, they've been strenuously stating, over and over again, that these aren't self-driving cars. Autopilot as a name for the technology is in line with how it's used and expected to perform in commercial airplanes. You still have to know how to fly the plane and you still need to stay vigilant.
Thankfully, they have a long way to go before they reach the limits of how far "only so far" is.
In fact, they've been strenuously stating, over and over again, that these aren't self-driving cars.
The first link I came to when searching "tesla fully automated hardware" was this: https://www.tesla.com/blog/all-tesla-cars-being-produced-now... I read the page twice, and didn't see a single outright statement that the cars aren't self-driving. Oh, I could infer it, but Tesla never came right out and said it, let alone "strenuously".
EDIT: because my search string was a bit loaded, in that I knew it would find the link I'm looking for, let's be more fair with:
"tesla fully automated driving" - the link above is the first listing
"tesla autonomous driving" - the link above is the 2nd link.
In summary, should I care to know more about Teslas and their autonomous driving abilities, I will likely be led to a page that never mentions that these cars can't drive themselves, but strongly implies that they can.
They only state that in response to "Tesla car involved in crash"-style reports. Otherwise, the messaging they send out is "our cars are basically self-driving." At best, Tesla is guilty of sending out severely mixed messaging, and at worst, they're lying to people and claiming that it's not lying because there is a footnote that's telling the truth (that is designed so that no one will see it).
The Tesla fans keep repeating this, but it flies in the face of the description of Autopilot on Tesla's website. I can't tell if they are being deliberately ignorant, or what. But the fact that Tesla claims you can press a button and summon your car, at least in my mind, says "cars that drive themselves".
Better names:
- Advanced cruise control
- Lane Following
Doesn't sound as sexy, though. :-)
Have you read the marketing on the website?
All you will need to do is get in and tell your car where to go. If you don’t say anything, the car will look at your calendar and take you there as the assumed destination or just home if nothing is on the calendar. Your Tesla will figure out the optimal route, navigate urban streets (even without lane markings), manage complex intersections with traffic lights, stop signs and roundabouts, and handle densely packed freeways with cars moving at high speed. When you arrive at your destination, simply step out at the entrance and your car will enter park seek mode, automatically search for a spot and park itself. A tap on your phone summons it back to you.
So it's not like this is a case of "it's called something that it isn't really", or mismanaged expectations. Tesla is explicitly stating the car drives itself. They still claim it's "Autopilot". Is what they are selling anything close to what is described there?
https://en.wikipedia.org/wiki/Autopilot
Furthermore, even if you're totally aware it's only assistance, there is a tendency to be more easily distracted. That's what a google study found like 5 years ago.
I am a huge Tesla fanboy, and stock holder. But be careful.. if you are struggling to remain vigilant... turn off autopilot.
Again, where do you get that this is a "misconception among the general public"? Read the marketing. Watch the demos. Listen to the claims.
"Tap your phone and the car will return to you". Where does being vigilant behind the wheel fit with that?
Cogging Cruise Control ?
The video says it doesn't have room to stop before hitting the first vehicle.
Not with ABS, you won't. Yes, I've tested this exact scenario. YMMV, based on the manufacturer.
The Ars article was not as clear-cut.
I am not passing judgement, merely making an observation/prediction.
Detecting these patterns is easier than pedestrian and bike detection because the problem space is so much more bounded. It's hard to give them a pass for not doing it.
I, and the other drivers behind me, avoided hitting the deer because we're used to dealing with them. Should we give Tesla a pass if it hits one because detecting a stationary deer is harder than detecting a stationary car?
1. Indicate to the driver that they drifting out of their lane 2. Warn about possible slow or stationary object ahead
If the driver knows that car won't take action on it's own, but will help them but telling them about things that can't see (or when they are distracted), then we wouldn't be blaming Tesla but the driver.
Disclosure: I currently own an Audi vehicle with this technology that has been available since 2009.
This is a stationary non metal car. This shows that Tesla's vision system cannot even recognize a car, much less any random obstruction on the road.
Because if we don't, software will have to code up the 'trolly car problem' solution, starting now. Hit the school bus ahead? or the guy walking beside the road? or the brick wall (and kill its passenger)? There's no good (universally defendable) solution.
I re-watched the video and it really doesn't look like the Tesla is breaking. The video says "unable to break in time". This to me sounds misleading. It is not clear whether Tesla tried to break but the distance was too short or it didn't attempt to break. Which leads me to conclude there's an agenda here.
In the U.S. at least, it's highly unlikely that the driver in front would be found legally at fault in a similar accident. In most cases of rear-end collisions, the driver who impacts the rear of the car will be found at fault.