News for hackers. Stuff that matters.
Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by Animats on Monday June 01, 2020 @04:09PM (#23383146)
Didn't even slow down. Humans often brake late, but seldom fail to brake at all.

It's grossly irresponsible of Tesla to ship a system that can't detect big, solid obstacles. This happens over and over. So far, they've hit a crossing semitrailer, a street sweeper, a car at the side of the road, a fire truck at the side of the road, and two road barriers. This has been going on for five years now, despite better radars and LIDARs.

Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by wcoenen on Monday June 01, 2020 @04:52PM (#23383672)
> Didn't even slow down.

The car in the video does seem to be braking strongly 1 second before the collision. There's a cloud emanating from the wheels.

> Humans often brake late, but seldom fail to brake at all.

Humans do fail to brake completely, e.g. when they fall asleep or have their eyes on their phone.

Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by dragontamer on Monday June 01, 2020 @05:58PM (#23384459)
https://www.youtube.com/watch?v=LfmAG4dk-rU&t=46

There are no brake lights on the Model 3. None at all. Based on this "reverse video", my conclusion is that the M3 doesn't even brake.

-------

Somewhat worrying is the pedestrian (the truck driver?) who jumps back to get out of the way of the M3. Not only did the M3 miss the truck, but the M3 didn't seem to see the pedestrian either.

Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by Groxx on Monday June 01, 2020 @08:46PM (#23385916)
That's a daytime video with a crappy camera at an abnormal-for-other-drivers angle. It's entirely reasonable for them to not be visible, both due to the low intensity difference and due to the angle not being what lights optimize for.

Also note all the cars that followed and clearly hit their brakes. They're invisible or nearly-invisible, except when they go through the overpass's shadow.

Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by mohaine on Monday June 01, 2020 @06:35PM (#23384843)
When the car goes into the shadow of the overpass you can clearly see the break lights on.
Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by Kye on Monday June 01, 2020 @06:34PM (#23384839)
The lights come on just before impact, but it's hard to tell if you don't look closely. They don't show as red due to the terrible video quality.
Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by globular-toast on Tuesday June 02, 2020 @05:35AM (#23389288)
Even the driver behind the Tesla seems to slam on the brakes at the last minute, lose control of the vehicle and then dangerously swerve across two lanes to pass the obstacle. What on earth is going on with these road users? I'd expect a very slow approach, hazard lights on, stop and check that everyone is OK before even thinking about continuing around the wreckage.
Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by ACow_Adonis on Monday June 01, 2020 @05:53PM (#23384410)
Looked to me like that might have been due to the pedestrian (driver?) in close proximity adjacent to the car at that point.

Puffs past him and then straight into the side of the truck.

Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by mark-r on Monday June 01, 2020 @08:44PM (#23385894)
So that brings up the question, was the car AI too focused on the pedestrian to notice the truck?
Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by cactuss4 on Monday June 01, 2020 @06:21PM (#23384697)
Looks more like it was trying to stop for the person standing in the road.
Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by GaryNumanVevo on Monday June 01, 2020 @10:07PM (#23386524)
the driver applied the brakes at the last moment
Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by screye on Monday June 01, 2020 @06:00PM (#23384486)
This is exactly why we need LIDAR.

Tesla has been very stubborn about avoiding LIDAR and this is what happens as a consequence. The rest of the self-driving scene fundamentally relies on LIDAR to get things working. Believe me, if cameras were sufficient people wouldn't use LIDAR . LIDAR is expensive. I have spoken to quite a few people in the field and the lack of LIDAR in Tesla vehicles baffles them.

Radar is not a substitute for LIDAR. Sound is really high latency and has terrible resolution.

I would like to see how often things like these happen with Waymo.

Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by jturpin on Monday June 01, 2020 @06:14PM (#23384629)
Maybe, the problem right now is that there is no module that Tesla can purchase and use on their cars. All the Lidar modules currently in use are these large and more importantly expensive spinning devices mounted on top of the car. These make sense for robotaxis, where cost and unsightliness are not an issue, but not an option for Tesla right now. I believe a couple companies have made headway with cheaper, smaller (solid state?) devices that might be an option in the near future, but these are just recent developments.
Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by clouddrover on Monday June 01, 2020 @06:44PM (#23384942)
Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by jturpin on Tuesday June 02, 2020 @02:12AM (#23388076)
That's a good point, I didn't know Audi was shipping a model with Lidar out and the price point is around where the Tesla's are. Certainly the reasons to not include Lidar are dropping.
Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by threeseed on Monday June 01, 2020 @07:53PM (#23385521)
This is the plan for the Cruise self driving car with LiDAR:

https://www.nytimes.com/2020/01/22/technology/cruise-gm-self...

Doesn't look unsightly to me. Also given that every car company and self driving car uses LiDAR suggests that over time the costs will come due to economies of scale.

Also are people not forgetting that Tesla charges a massive premium for Autopilot ? People are willing to pay a lot for self driving more than enough to cover the cost of the LiDAR sensor.

Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by icelancer on Tuesday June 02, 2020 @01:35AM (#23387829)
>> Doesn't look unsightly to me. Also given that every car company and self driving car uses LiDAR suggests that over time the costs will come due to economies of scale.

This has been predicted for radar units over optical in other industries. It never happened. Optical became cheap and capable, radar stayed slow and expensive. I see no reason why this would change in car manufacturing.

Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by trog on Monday June 01, 2020 @06:29PM (#23384780)
How about laser rangefinders? Even one of them in the centre of the vehicle in the direction of travel would be useful for high speed impact avoidance - well, assuming they work reliably and how I think they do; I'm not a hardware guy. But would a laser rangefinder pointing forward be useful? They're not that big and bulky and should at least be useful for braking when it detects something closing too rapidly...?
Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by bentcorner on Monday June 01, 2020 @07:51PM (#23385512)
Just spitballing but would those have problems in rain/fog/smoke?
Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by sukilot on Monday June 01, 2020 @08:10PM (#23385653)
You know what a smart driver does in rain/fog/smoke? Slow down.
Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by bentcorner on Monday June 01, 2020 @10:35PM (#23386724)
I guess I should be more clear - I'm guessing (but I could be wrong) that a laser rangefinder would consider heavy rain/fog/smoke to be a solid barrier and wouldn't slow down, it'd stop.
Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by trog on Tuesday June 02, 2020 @01:28AM (#23387781)
That would be my guess too.. but that's probably what you want to happen if automated sensors are unable to perceive the world around them - slow and stop the car until a human takes over again...?
Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by mprovost on Tuesday June 02, 2020 @01:50AM (#23387919)
Lidar is a laser rangefinder.
Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by habitue on Monday June 01, 2020 @06:29PM (#23384783)
> Believe me, if cameras were sufficient people wouldn't use LIDAR

I don't necessarily think LIDAR is a bad idea, but this logic seems kind of circular. Isn't the issue that nobody knows what's sufficient? At the very least the engineers at Tesla seem to think LIDAR isn't necessary (maybe not a slam-dunk argument but humans don't use LIDAR to drive, so it's at the very least plausible computer vision systems alone are sufficient)

Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by lnanek2 on Monday June 01, 2020 @09:15PM (#23386116)
That's like saying humans have consciousness, so strong AI is at least very plausible. Possible, sure? Possible in the next decade? Probably not.
Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by Cerium on Monday June 01, 2020 @06:05PM (#23384528)
Radar is not sonar. The latency for radar is good, but the resolution is indeed poor.
Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by throwaway0a5e on Monday June 01, 2020 @06:33PM (#23384825)
If you're willing to spend DOD type bucks you can get some insanely good (like the old boring legacy tech will keep track of a city's worth of vehicles and dismounts without getting them all confused with each other) radar. The secret sauce is in the algorithms though and lord knows how many millions of dollars and man hours have been poured into that.
Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by mlyle on Monday June 01, 2020 @06:38PM (#23384868)
Limited aperture on a car means limited angular resolution even with millimeter wave. This can mean the information needed to tell whether something stationary is in your path just isn't there-- especially in the vertical direction where aperture is smaller.

A big flat surface that's not normal to you like the box truck may also not be a very large return.

Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by kube-system on Monday June 01, 2020 @09:26PM (#23386205)
Yeah, my 6 year old Toyota has millimeter wave radar, and so do a lot of cars, for detecting objects in front of the vehicle.
Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by SomewhatLikely on Monday June 01, 2020 @07:59PM (#23385578)
Doesn't seem like it was necessary here. I'm no computer vision expert, but surely parallax between multiple cameras and/or multiple time points would make detecting such a massive object simple.
Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by MauranKilom on Monday June 01, 2020 @08:03PM (#23385602)
Large uniform/featureless surfaces are the bane of stereo vision. And propagating in from the borders is extremely risky if there's any occlusion affecting the borders (read: if you get the borders wrong).

Maybe in this particular instance you could look at the data and go "yep, that white surface is indeed closing in and not just some part of the sky". But how many false positives do you allow for "there's a huge thing in my way that requires emergency braking" in interstate scenarios?

Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by screye on Monday June 01, 2020 @08:17PM (#23385687)
This actually seemed like an adversarial case.

It seems like the color of the truck and that of the road were near identical to each other. Maybe no different that what it looks like when the road changes textures to a worse surface or or hits an odd pot hole.

It is likely the car alerted the owner to take over, but did not brake on its own.

The thing about LIDAR is detecting objects becomes shit easy. One thing is for sure. I can guarantee such an accident would not have happened with LIDAR.

Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by aeternum on Monday June 01, 2020 @08:56PM (#23385984)
It's surprising they did not train for this given very similar accidents (hitting semi-trucks) in 2016 and 2019.

LIDAR isn't a surefire solve, it also has issues with large white surfaces and bright sunlight.

Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by jeffreygoesto on Monday June 01, 2020 @04:52PM (#23383673)
Tesla only uses Cameras (trained for "normal appearance" of cars, that is front and back views) and Radar (notoriously high false positive rate for standstill targets aka clutter, they need to be suppressed to be driving without hard braking every now and then), no Lidar. This overturned truck would have been difficult to incorporate into a training set for semantic labeling if you want to have a safe reaction for all kinds of unusual objects together with a reasonable false positive rate. Similar classification failures in all those cases. Can't be solved reliably with just vision and Radar.
Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by aquadrop on Monday June 01, 2020 @05:25PM (#23384069)
Can't radar and cameras augment each other and help to solve false positives? I just don't understand, it's pretty simple thing to notice, humans can solve it with vision only. It doesn't need to label what it is exactly, it just needs to understand that there's something, and it's probably not a good idea to plow in it full speed. I'm very positive about what Tesla is doing overall but this issue seems to be unresolved for years, and the way they handle these cases information-wise is also bad.
Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by TaylorAlexander on Monday June 01, 2020 @06:03PM (#23384513)
Computer vision is far behind human vision. Human vision includes the human brain, which we have not been able to come close to replicating. I am working on a years long computer vision project right now. We still struggle to do basic tasks that humans can do easily.

Making a computer vision system for a car that always knows what images mean the road is clear and what images mean the road is blocked with 100% accuracy is very hard.

That said, Tesla has also said they can determine the 3D geometry of the scene using only computer vision, which is certainly a known task (called photogrammetry or structure from motion). However it seems their algorithm failed in this case to accurately judge depth. With a clear picture and a well understood camera system it is pretty do-able, but I haven't looked at this article so perhaps the footage was not sufficiently clear.

Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by samatman on Monday June 01, 2020 @05:57PM (#23384455)
> it's pretty simple thing to notice, humans can solve it with vision only

Yes.

Unfortunately, this wasn't human vision: it was computer vision.

When both systems succeed, they by definition succeed similarly: I say by definition, because human vision is the only judge of computer vision's success.

When they fail, they fail completely differently.

Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by SiempreViernes on Monday June 01, 2020 @05:30PM (#23384130)
You can read the article, and see the video yourself, and the answer is no: Tesla couldn't manage reliable detection of "big object blocking the way".
Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by serf on Monday June 01, 2020 @05:41PM (#23384272)
yeah, but Tesla being unable to do it doesn't mean that someone can't.

It's a hard problem, but a system with more sensory inputs than the human optical system shouldn't solve the same problem worse -- this points to a real issue in the problem solving methodology, but doesn't do much to condemn the idea of camera/radar fusion.

Now, if the question was "Can Tesla do this reliably?" -- different answer.

Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by AareyBaba on Monday June 01, 2020 @06:45PM (#23384961)
This is what symbolic AI skeptics in the 90's dismissed as 'brittle' solutions. You engineer an AI system, then find it fails under some unforeseen situation. You fix for that situation and find it fails under some other unforeseen situation.

I was driving on the highway the other day and there was a large black object ahead in my lane. I was about to take evasive action when the object shifted slightly. The motion was enough for my brain to sense it was a lightweight object (not a human fallen on the road) and a further movement in a puff of wind to establish it was an empty garbage bag rolling on the highway. No need for evasive action.

On the other hand if I had seen other debris/leaves tumbling in the wind but the black object was stationary my brain would have sensed it as a potentially heavy object and taken evasive action.

I remain skeptical that we can if-then-else engineer our way to self-driving until cars have the common sense adaptive behavior that humans have.

Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by TaylorAlexander on Monday June 01, 2020 @06:05PM (#23384531)
The human system includes the human brain, which is an important part. We can easily make optical sensors that have better visual acuity than the human eye, but "scene understanding" continues to be a task where humans dramatically beat computers. The brain is an important part of this.
Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by reitzensteinm on Monday June 01, 2020 @07:11PM (#23385179)
There's no question we'll get there eventually. But what's the timeline?

The first principles argument can be made just as well about setting up two cameras and some robotic hands to converse on HN and acquire karma.

Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by salawat on Monday June 01, 2020 @06:24PM (#23384739)
It's perfectly reasonable for a system with more sensory inputs than a human to fail at a task a human does with just the one.

Do you think the car understands cause and effect? Do you think the car actually groks object persistence? Do you think that the car has any sense of value attached to it's own existence? Or an instinct to increase the amount of time it has to resolve a reading it doesn't understand?

This is the failing of your lab trained neural network. It is only trained and proficient in what it knows, and only that. It doesn't have a sense of self. It doesn't have intuition, instinct for survival, or any of the millions of other simultaneous neural subprocesses that even the simplest biological creatures possess to keep themselves alive. It can't forget, neither can it learn in it's runtime state. It's a crapshoot whether it'll do everything it is supposed to how it is supposed to just like it is when a human (coincidently, another neural network driven creature) gets behind the wheel.

You won't build a perfect neural network for X just like you can't make a perfect human by selective lobotomy. There is only so much neural ductility that can be accommodated.

Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by aquadrop on Monday June 01, 2020 @05:52PM (#23384392)
I read the article and saw the video. I'm answering to the comment talking about the general problems of the approach.
Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by kube-system on Monday June 01, 2020 @09:34PM (#23386272)
Humans do have range-finding capabilities due to binocular vision.
Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by adrr on Monday June 01, 2020 @06:57PM (#23385060)
Tesla doesn’t always suppress radar. My Tesla will occasionally phantom brake due to long sweeping left hand curves in the carpool lane with the adjacent lane stopped or low hanging road signs.
Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by bsder on Monday June 01, 2020 @05:34PM (#23384184)
> Radar (notoriously high false positive rate for standstill targets aka clutter, they need to be suppressed to be driving without hard braking every now and then)

Really? My adaptive cruise on my bog-standard GM Volt seems to have no problem seeing static obstacles with it's "primitive" radar.

Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by nickff on Monday June 01, 2020 @05:55PM (#23384426)
The problem is not "seeing" the stationary obstacles, the problem is distinguishing ones in the lane from those outside. Issues arise when you try to avoid false positives (such as cars in a different lane in a turn, etc.).
Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by bsder on Monday June 01, 2020 @09:46PM (#23386343)
> the problem is distinguishing ones in the lane from those outside.

My vehicle is doing adaptive cruise to the car in front of it--including on banked curves and in Los Angeles traffic--sometimes dense-sometimes empty. This means that it is working out which car is in my lane--probably via beam steering and corresponding to my steering wheel position.

This doesn't seem to be an impossible problem. This seems to be a Tesla problem.

Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by kalleboo on Tuesday June 02, 2020 @01:18AM (#23387705)
This article has a longer discussion on the limitations of radar for emergency braking systems https://arstechnica.com/cars/2018/06/why-emergency-braking-s...

This one discusses that the Volvo system has the same limitation, and implies that most others do too https://www.wired.com/story/tesla-autopilot-why-crash-radar/

Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by adinisom on Monday June 01, 2020 @06:00PM (#23384479)
The one in mine signals collision warnings on metal signs above the road. Although in fairness it's never triggered emergency braking.
Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by tenpies on Monday June 01, 2020 @06:08PM (#23384562)
Also interestingly: AEB did not trigger.

It's not the first case I've seen where Tesla's Autopilot seems to override AEB[1]. Definitely confirmed behaviour to-date and seen as early as Q1 of this year. Any car from 2009 or later with AEB would have avoided this collision.

It probably would be great if car software didn't follow the "move fast and break things" mantra.

---

[1] https://www.consumerreports.org/car-safety/automatic-emergen...

Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by lutorm on Monday June 01, 2020 @07:40PM (#23385415)
I don't think that's true. As far as I know, typical AEB systems are radar-based and can't determine what's on or off the road, so they rely on Doppler to pick out the car in front from the environment. If you're driving up towards a completely stationary object, it will have a very hard time detecting it.
Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by kalleboo on Tuesday June 02, 2020 @01:15AM (#23387689)
When we bought our used car, we were deciding between a slightly newer model and a slightly older model, and one of the differences was the older model used stereo vision for AEB and the newer model used radar. Even the car salesman said that the stereo vision worked better (as it detects stationary objects). I wonder why the move to radar. Is it cheaper?
Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by kube-system on Monday June 01, 2020 @09:29PM (#23386233)
This is instantly noticeable if you drive a vehicle with radar cruise. It won't slow down if you're pointed at a stationary object.
Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by Reason077 on Tuesday June 02, 2020 @06:00AM (#23389412)
Modern AEB systems use cameras in addition to radar, and some are actually camera-only. Besides stationary obstacles, you need a camera to detect pedestrians, cyclists, etc.
Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by Reason077 on Tuesday June 02, 2020 @05:57AM (#23389400)
> "Also interestingly: AEB did not trigger."

Looking at the video, a bunch of dust seems to be kicked up around 1.5 seconds before the impact, suggesting hard braking. Clearly it activated too late to avoid the collision, but it certainly would have reduced the energy of the impact, and thus potential injury to occupants.

Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by sgt on Monday June 01, 2020 @04:44PM (#23383570)
Doesn't this take us back to the discussion around the word Autopilot? Tesla sells it as driver-assist, no more autonomous than an autopilot system in a Boeing 737. Good for following the obvious path, and otherwise needs input from the actual pilot.
Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by detaro on Monday June 01, 2020 @05:36PM (#23384211)
Airliners have the large benefit that solid obstacles don't tend to suddenly appear in their flight paths (and the most likely candidate, other planes, is being kept away by ATC and failing that warned about by transponder systems), so the cruise-altitude "follows the obvious path" is a lot more useful.

That doesn't protect against operator errors of various kinds (set course into a mountain, didn't realize the autopilot was disengaged, ...), but is a large difference from streets. Even in planes pilots taking over when automation encounters a situation it can't handle is a risk due to potential confusion about the current situation, and on streets the reaction times necessarily to react to an autopilot failure are typically way shorter.

Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by Someone on Monday June 01, 2020 @04:55PM (#23383702)
They have backpedalled a bit, but https://www.tesla.com/model3:

“Autopilot enables your car to steer, accelerate and brake automatically within its lane“

to me, seems to apply to this event.

To me, it also looks as if it almost hit a person, too (the driver of the van?)

Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by AlexandrB on Monday June 01, 2020 @06:10PM (#23384591)
> To me, it also looks as if it almost hit a person, too (the driver of the van?)

You’re right, I hadn’t noticed that! That’s even worse. Seeing a person on the side of the road is not that uncommon and is a near-certain fatality if a collision occurs.

Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by tenpies on Monday June 01, 2020 @06:06PM (#23384539)
If only we had a regulatory agency that monitored this sort of stuff and then punished companies that used exploitative language to dangerously market their products as something they are not.
Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by c22 on Monday June 01, 2020 @04:54PM (#23383695)
It seems like the obvious path would be around solid obstacles. I've never driven a Boeing 737, but will the autopilot really fly you directly into an obstacle with no warning at all? My understanding was that these vehicles are equipped with radar and collision avoidance systems.
Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by serf on Monday June 01, 2020 @05:48PM (#23384362)
Aviation auto-pilot will most definitely fly you into things.

Systems exist which will override auto-pilot in the event of such happenings, like Auto-GCAS (ground collision avoidance systems) and equivalents, but these aren't really designed for sudden obstructions -- they are mostly designed to help regain level flight if a pilot becomes unresponsive during maneuvers and is pointed in A Bad Way -- but auto-pilot is not going to be engaged during such flight, anyway. But systems like this do have authority to disengage whatever other systems that may interfere with their operation, like auto-pilot.

There are many onboard systems to allow awareness of such conditions that will result in collision, but not much in control of actual flight characteristics on any but the most advanced or experimental planes.

Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by SiempreViernes on Monday June 01, 2020 @05:25PM (#23384068)
Yeah, probably. The use case is keeping the plane stable in a big empty space.

I don't think civilian air planes have any collision avoidance radar, because as late as 2006 we get mid air collisions like this: https://en.wikipedia.org/wiki/Gol_Transportes_A%C3%A9reos_Fl...

Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by netsharc on Monday June 01, 2020 @05:35PM (#23384197)
The planes don't use radar but rely on transponder data and have TCAS (https://en.wikipedia.org/wiki/Traffic_collision_avoidance_sy...) that would coordinate with each other, and yell at one plane's pilot to go up and the other's to go down.

In that accident the smaller plane had its transponder switched off.

A passenger on the smaller plane (which had zero casualties) wrote about it from his point of view: https://www.nytimes.com/2006/10/03/business/03road.html

Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by mark-r on Monday June 01, 2020 @08:59PM (#23386009)
I once saw a near miss of 2 civilian planes. One was taking off from an airport next to Lake Superior, and the other was a float plane taking off from the adjacent bay. I only noticed because I heard the engines rev up as they took evasive maneuvers.
Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by rsynnott on Monday June 01, 2020 @05:38PM (#23384226)
Some Airbus planes have them, but I think it’s an optional extra.
Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by floatingatoll on Monday June 01, 2020 @05:12PM (#23383887)
Generally, non-military aircraft avoid collisions using radio broadcasts from various beacons (their own and those of other planes). Actual radar systems for detecting non-broadcasting obstacles are, per Wikipedia, generally only found on military aircraft. So if you define "an obstacle" as something that is not a plane broadcasting a beacon, then, yes, a Boeing 737 would probably run directly into it if it were somehow in the path of the autopilot.
Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by s_y_n_t_a_x on Monday June 01, 2020 @05:21PM (#23384001)
Yes it will, autopilot just keeps the heading and the altitude.

There may be other sensors onboard that help with detections (it is a lot more expensive after-all) but the autopilot control system does no such thing.

Even with all the sensors onboard, the 747 would most likely run into something without assistance, in fact I've seen a few cases of this on Air Disasters.

Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by Someone on Monday June 01, 2020 @05:27PM (#23384094)
The autopilot will, but many airplanes do have separate systems for collision avoidance (https://en.wikipedia.org/wiki/Airborne_collision_avoidance_s...)
Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by m463 on Monday June 01, 2020 @06:58PM (#23385068)
It's pretty irresponsible to put a 16-year old behind the wheel, but we do it every day.

We just put another driver in there to check things.

In the same way, what I think is:

driver - pretty safe

autopilot - pretty safe

driver + autopilot - safest

Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by mark-r on Monday June 01, 2020 @09:04PM (#23386036)
That's absolutely wrong. A driver without assist will be fully engaged, while with assist they'll be tempted to divert their attention. Once attention is diverted they're no better than autopilot on its own.
Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by m463 on Tuesday June 02, 2020 @01:05AM (#23387648)
a teenager will do the exact same thing.
Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by mark-r on Tuesday June 02, 2020 @08:44AM (#23390376)
So a teenager is more likely to get in an accident than the average driver. I think the insurance companies have been aware of that forever.

My point is that while driver+autopilot is claimed to be the safest option, I contend that it is less safe than driver only. At least at the current state of technology, and even including teens.

Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by maxdo on Monday June 01, 2020 @07:15PM (#23385207)
it did emergency brakes,that's why the person remains alive and totally unharmed.
Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by xvector on Monday June 01, 2020 @10:12PM (#23386560)
No, the driver applied the brakes
Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by movedx on Monday June 01, 2020 @06:08PM (#23384568)
> This happens over and over. So far, they've hit a crossing semitrailer, a street sweeper, a car at the side of the road, a fire truck at the side of the road, and two road barriers. This has been going on for five years now, despite better radars and LIDARs.

And in that time, how many people have crashed into other people, whether they're in cars or not? Buildings? Walls? Children?

Are you claiming that Tesla's safety performance is worse than that of people?

Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by bsaul on Monday June 01, 2020 @06:27PM (#23384758)
Man, this kind of arguments is getting tiring... It is obvious that 100% of human in the OP situation having no particular medical condition would perform better than tesla autopilot.

Tesla’s autopilot doesn’t fail because of malfunctions such as short-circuits or bad weather conditions, or anything special happening (as opposed to humans), it fails under perfectly normal condition.

You can’t even start to compare autopilot safety performance to people performance unless you work for tesla’s marketing, for the simple reason that no human is in theory authorized to let that thing drive itself without supervision. What you’re comparing is human + autopilot vs only human.

What seems extraordinary, is that human+autopilot actually performs worse than just humans in some conditions, such as OP, simply because of the way autopilot was advertized.

Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by dmitrygr on Monday June 01, 2020 @08:24PM (#23385743)
> human+autopilot actually performs worse than just humans in some conditions,

This is well studied in the aviation field, and an entire subfield of psychology to study this exists called "Human Factors".

There are many many fascinating results from studies in Human factors in aviation, but one that I can point out is that humans pay less and less attention as you present them with more and more reliable automation, to a point where automation can start to decrease safety, as humans get so complacent, relaxed, and distracted (my instructor called this "flying fat dumb and happy") that when they ARE called upon to take over and act suddenly, they simply are entirely unaware of the situation and need more time to get the hang of it than there is time before decisive action is needed.

Some reading:

https://www.skybrary.aero/index.php/Cockpit_Automation_-_Adv...

https://www.ise.ncsu.edu/wp-content/uploads/2017/02/Parasura...

Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by atgprime on Monday June 01, 2020 @06:47PM (#23384981)
There's a very simple fix, which is to have a human driving and allow autopilot to work only in an emergency, when it detects the car is about to crash. Then you get all of the touted safety advantages, and none of the bizarre accidents.
Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by bsaul on Tuesday June 02, 2020 @02:52AM (#23388359)
unfortunately i don't think detecting potential crash is that easy ( and i think it's part of the original problem).

eg in OP. There could also be other situation where autopilot think there's a problem when there's none.

Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by jodrellblank on Monday June 01, 2020 @06:39PM (#23384878)
Tesla has shipped ~1M cars total, USA registers ~250M new cars every year. Accidents happen around 1 in 50 cars per year in the USA. Most of the human accidents happen while drunk, distracted, speeding, or driving recklessly. Suspiciously the DriverKnowledge source adds these up to 103% of causes.

But we can say that a Tesla autopilot is never drunk, distracted, should never be speeding or driving recklessly. Crashing into an upturned truck, a fire truck, a street sweeper, a parked car, while sober, paying attention, driving carefully and attentively, is worse than human driving.

[1] https://www.statista.com/statistics/502208/tesla-quarterly-v...

[2] https://www.statista.com/statistics/183505/number-of-vehicle...

[3] https://www.driverknowledge.com/car-accident-statistics/

Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by phs318u on Monday June 01, 2020 @06:23PM (#23384720)
The answer would depend on no. of incidents per km driven. Apples to apples.
Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by spuz on Monday June 01, 2020 @05:17PM (#23383954)
> It's grossly irresponsible of Tesla to ship a system that can't detect big, solid obstacles.

I think this is a case of something that seems grossly irresponsible because it's a task that humans can do extremely easily. Clearly, if LIDAR cost nothing then Tesla would happily use it in their cars. The reality is that a technology that can perform as well as a human at static object detection is cost prohibitive which is why you don't see it in any mass market vehicles. I would imagine in some cases a human driver i.e. a taxi still costs less than LIDAR.

So it becomes a question of how responsible should we make Tesla for the expectations that some of their customers may have when they release any kind of driver assistant technology? You can argue both ways that it would be irresponsible of them to release the technology that they have now without guaranteeing that every driver will fully understand its limits but also that it would be irresponsible of them not to release such technology given the number of lives it can save in its current form.

Re:Tesla Model 3 Drives into Overturned Truck in Apparent Au... by michaelmrose on Monday June 01, 2020 @06:06PM (#23384534)
Presumably it would cost even less not to include this feature at all. I think a reasonable question is if this feature avoids more collisions in more average conditions or causes more in extraordinary ones.

Even if it saves more than it costs it might cost more in pr and court costs than is earned from selling the feature.

It is probably impractical to sell something that saves 2 people that we cannot innumerate or name if it kills one person with a name, address, next of kin, and lawyer.