News for hackers. Stuff that matters.
Re:Tesla auto-pilot keeps confusing moon with traffic light ... by gerash on Wednesday July 28, 2021 @04:23PM (#27989266)
I can't understand why instead of using all the possible senses: vision, auditory, radar, lidar they want to only use vision as if there's some sense of "purity" in doing that.
Re:Tesla auto-pilot keeps confusing moon with traffic light ... by njarboe on Wednesday July 28, 2021 @04:59PM (#27989626)
I think one of the main reasons for Tesla to use only vision is that then the mistakes the system makes will be more understandable and thus acceptable to humans. The way radar and lidar systems fail and cause wrecks will seem strange to humans, like running into stationary objects. Even if using these sensors would make system better overall, they might not be worth including if one is shooting for human acceptance of the system as fit for use.

An autocar seeing something that looks like a red light and breaking (or breaking for a bit and then continuing after deciding it was not a red light) is going to be acceptable to people because that is how they behave. Phantom breaking due to some radar or lidar input that the human can't perceive is going to be interpreted very negatively. I imaging auditory might be added at some point, if it is not already being used.

Re:Tesla auto-pilot keeps confusing moon with traffic light ... by bathtub365 on Wednesday July 28, 2021 @06:52PM (#27990784)
I find the mistakes it makes to be less understandable because I can see with my eyes that the light in the sky is the moon, and not a traffic light. Why can’t the car?
Re:Tesla auto-pilot keeps confusing moon with traffic light ... by jillesvangurp on Wednesday July 28, 2021 @05:56PM (#27990261)
Three reasons:

1) They have hundreds of millions of cars sold already with cameras that they can up-sell this to. That means more revenue. But more importantly, more training data. Massive amounts of it. Training data is the real value here. Radar/lidar/etc. might be able to detect better what is obvious to a human just looking at a thing. But given enough training data, a machine learning can probably replicate that capability so you don't actually need the fancy sensors. Adding new sensors to the mix would set them back quite a while on that front.

2) Simplicity. More sensors means more complexity integrating all the signals and gathering the right training data. More failure modes, etc. It probably also means more compute power needed to process all that data. More complex testing, etc. Scaling by keeping the sensor platform simple is a good move here.

3) The hard part of autonomous driving is actually interpreting visual signals in complex or unusual/rare situations. Roads are designed for humans with eyes. Lidar sees a blob, radar detects a pole, a camera sees a traffic sign, road markings that mean something, etc. It's a much richer signal. All the important stuff on roads is clearly visible. So, cameras are far more important for this than lidar/radar. Those are really great for avoiding crashing into things. Not so much for interpreting and classifying those things. And Tesla seems to be doing pretty OK with not crashing into things. Mostly, the amusing edge cases have to do with misinterpreting visual signals for which radar and lidar are probably not that relevant.

It's an interesting approach that they clearly believe that they can make work. It does not actually stop them from later adding more hardware to enhance things if they decide those things are needed. But it's quite interesting how far they are getting with just cameras.

Re:Tesla auto-pilot keeps confusing moon with traffic light ... by stonewareslord on Wednesday July 28, 2021 @06:20PM (#27990507)
For #1: wouldn't more sensors be even better for training? If vision does not pick up an object like a human, but lidar detects a human sized object, the vision portion of the model can 'learn' from it's mistakes.

The other two sound like good reasons though

Re:Tesla auto-pilot keeps confusing moon with traffic light ... by jillesvangurp on Thursday July 29, 2021 @07:50AM (#27995360)
Except that would kind of invalidate all the training data they've gathered for the last years which does not have data for these sensors. That would be a major setback and might take years to fix. Probably they started ignoring the radar sensor content quite some time ago when they realized they did not need it. They never had any lidar.

Obstacle detection with lidar/radar is only interesting if you assume that object avoidance is a problem with camera based obstacle detection right now. There are lots of incidents with Teslas but I don't recall them running over pedestrians or crashing into vehicles a lot. Mostly incidents are about misinterpreting visual signals; not about crashing into stuff. If anything, their safety statistics are pretty good when autopilot is on. The cars still do dangerous/illegal/misguided things due to misinterpreting of traffic situations but it's then smart enough to get the driver out of trouble before bad things happen.

Re:Tesla auto-pilot keeps confusing moon with traffic light ... by nr2x on Wednesday July 28, 2021 @04:28PM (#27989307)
Pure cost cutting at expense of safety certainly.
Re:Tesla auto-pilot keeps confusing moon with traffic light ... by rcMgD2BwE72F on Wednesday July 28, 2021 @04:56PM (#27989594)
So they could put PS5-level gaming rigs in their cars? How logical https://www.theverge.com/2021/6/1/22462660/amd-tesla-model-x...
Re:Tesla auto-pilot keeps confusing moon with traffic light ... by nr2x on Wednesday July 28, 2021 @06:44PM (#27990712)
Oh you’re right, I didn’t realize they are investing in safety features like putting gaming consoles in car dashboards. That will save millions of lives.

All Hail Elon.

Re:Tesla auto-pilot keeps confusing moon with traffic light ... by jliptzin on Wednesday July 28, 2021 @04:43PM (#27989462)
Humans do fine with only 2 cameras
Re:Tesla auto-pilot keeps confusing moon with traffic light ... by dreamcompiler on Wednesday July 28, 2021 @05:19PM (#27989864)
Chimpanzees have the same number of cameras as humans. Yet we don't let them drive. It's a puzzler. /s
Re:Tesla auto-pilot keeps confusing moon with traffic light ... by zamalek on Wednesday July 28, 2021 @04:55PM (#27989588)
In addition to the sibling comments, humans are also terrible drivers. They almost universally confuse confidence with ability.
Re:Tesla auto-pilot keeps confusing moon with traffic light ... by nr2x on Wednesday July 28, 2021 @06:45PM (#27990719)
Hm, almost like tech CEOs.
Re:Tesla auto-pilot keeps confusing moon with traffic light ... by givinguflac on Wednesday July 28, 2021 @04:53PM (#27989565)
*And a brain that outclasses anything Tesla could currently put into their vehicles by numerous orders of magnitude.
Re:Tesla auto-pilot keeps confusing moon with traffic light ... by HoDaMoFoDor on Wednesday July 28, 2021 @04:50PM (#27989535)
Humans also have GI.
Re:Tesla auto-pilot keeps confusing moon with traffic light ... by nr2x on Wednesday July 28, 2021 @06:45PM (#27990731)
…and yet…
Re:Tesla auto-pilot keeps confusing moon with traffic light ... by LeoPanthera on Wednesday July 28, 2021 @04:34PM (#27989360)
Which of the above would solve this problem?
Re:Tesla auto-pilot keeps confusing moon with traffic light ... by mtalantikite on Wednesday July 28, 2021 @04:39PM (#27989412)
I'm not an expert, but I'm guessing Tesla's version of lidar wouldn't detect the moon. It's probably a bit out of range.
Re:Tesla auto-pilot keeps confusing moon with traffic light ... by rcMgD2BwE72F on Wednesday July 28, 2021 @05:20PM (#27989871)
And when the moon shows up next to a pole, a bridge or any high up structure, the car comes to a stop because it "sensed" something. You must solve vision anyway, so why use a crutch?
Re:Tesla auto-pilot keeps confusing moon with traffic light ... by cogman10 on Wednesday July 28, 2021 @04:38PM (#27989399)
LIDAR.

You'd be able to tell there's no object anywhere near the car and disregard the light.

Re:Tesla auto-pilot keeps confusing moon with traffic light ... by adolph on Wednesday July 28, 2021 @04:55PM (#27989586)
https://youtu.be/NSDTZQdo6H8?t=391

In the above video Andrej Karpathy claims that LIDAR required previously compiled maps, the creation of which is not scalable. Do you disagree with that point of view?

Re:Tesla auto-pilot keeps confusing moon with traffic light ... by cogman10 on Wednesday July 28, 2021 @05:00PM (#27989643)
Andrej's claim isn't that you need those maps, it's that using those maps is how today's LIDAR approach work.

Without the maps, you'd need to rely pretty heavily on vision to do the right thing.

What LIDAR gives you is a very accurate point cloud to work from. You can get a point cloud from vision (and indeed, that's what telsa is doing) but it won't be near as accurate as LIDAR is by default.

Re:Tesla auto-pilot keeps confusing moon with traffic light ... by rcMgD2BwE72F on Wednesday July 28, 2021 @04:49PM (#27989527)
Unless it's hanging from a cable https://www.masterfile.com/image/en/700-08743685. But then, it could be a streetlight so only vision can solve this problem https://www.123rf.com/photo_2753272_hanging-street-lamp.html
Re:Tesla auto-pilot keeps confusing moon with traffic light ... by cogman10 on Wednesday July 28, 2021 @04:56PM (#27989597)
You need vision to determine it is or isn't a traffic light.

Lidar would be able to tell you if the object should even be evaluated.

A light hanging from a cable would still get a lidar ping back. The moon would be a void with no lidar ping.

Re:Tesla auto-pilot keeps confusing moon with traffic light ... by rcMgD2BwE72F on Wednesday July 28, 2021 @05:11PM (#27989774)
So LIDAR says there's something, and maybe the car should stop.

Maybe is not acceptable (and blind in the rain/fog), so you must rely on vision to make the decision – which is why Tesla goes straight to the heart of the problem.

They haven't solved it yet, obviously, but neither has Waymo or anyone else. Tesla is probably collecting more images of 'moon or traffic light?' images than the rest of the industry combined already.

Re:Tesla auto-pilot keeps confusing moon with traffic light ... by gerash on Wednesday July 28, 2021 @04:38PM (#27989396)
Lidar could make this false prediction less likely.

That said, the computer vision is still far from human level. It lacks a common sense around how the world works.

Re:Tesla auto-pilot keeps confusing moon with traffic light ... by jillesvangurp on Wednesday July 28, 2021 @05:29PM (#27989982)
Probably just a bit more training data and cameras will do just fine. It's a funny edge case; nothing more. I'd be surprised if it will remain a problem.
Re:Tesla auto-pilot keeps confusing moon with traffic light ... by barbazoo on Wednesday July 28, 2021 @04:39PM (#27989408)
Radar and Lidar perhaps, being based on reflection of radio waves/laser off surfaces.
Re:Tesla auto-pilot keeps confusing moon with traffic light ... by cogman10 on Wednesday July 28, 2021 @04:40PM (#27989434)
Radar isn't sensitive enough. LIDAR is.
Re:Tesla auto-pilot keeps confusing moon with traffic light ... by rcMgD2BwE72F on Wednesday July 28, 2021 @05:00PM (#27989638)
LIDAR is so sensitive it can't reliably detect traffic lights in the rains. So you must rely on vision anyway (which is Tesla's).
Re:Tesla auto-pilot keeps confusing moon with traffic light ... by barbazoo on Friday July 30, 2021 @02:50PM (#28011040)
I suspect both would have been able to tell that the moon isn't a traffic light.
Re:Tesla auto-pilot keeps confusing moon with traffic light ... by soperj on Wednesday July 28, 2021 @04:39PM (#27989415)
It's entirely cost.
Re:Tesla auto-pilot keeps confusing moon with traffic light ... by stevenpetryk on Wednesday July 28, 2021 @04:40PM (#27989438)
I mean, it's gotta be style and complexity too. LIDAR are quite ugly on test vehicles. Cameras are much simpler and easier to hide among the body.
Re:Tesla auto-pilot keeps confusing moon with traffic light ... by rcMgD2BwE72F on Wednesday July 28, 2021 @05:06PM (#27989713)
Because Tesla lacks money?

Their automotive gross margin is 28% (Toyota is at 17.76%). If one automaker could afford LIDAR, it's Tesla.

Re:Tesla auto-pilot keeps confusing moon with traffic light ... by soperj on Wednesday July 28, 2021 @05:44PM (#27990130)
LIDAR has come down a lot in cost over the last decade, but it would still eat up that whole 28% and more.
Re:Tesla auto-pilot keeps confusing moon with traffic light ... by extropy on Wednesday July 28, 2021 @04:41PM (#27989443)
Using all the senses would not solve the problem. Vision is the only one with enough resolution to matter.

That said: - way cheaper - more reliable - less power hungry - simpler and easier to debug.