News for hackers. Stuff that matters.
Re:Andrej Karpathy: Why Tesla Removed Radar and Ultrasonic S... by 3apo on Sunday October 30, 2022 @04:20PM (#33398238)
I feel the other reason is that Tesla has not figured out a way to put Radar into their ML pipeline. If you take the Range-Doppler Map from the radar as the 'pixel' map, that data is inherently very dependent on the scenario and the radar sensor intrinsic parameters. This variability in what the radar sees in the RD space is what makes this a challenge for ML/AI pipelines. If Tesla were to 'fuse' information from these sensors in the object track level - I believe they will be less susceptible to this variability.
Re:Andrej Karpathy: Why Tesla Removed Radar and Ultrasonic S... by dreamcompiler on Sunday October 30, 2022 @09:04PM (#33400829)
Exactly. Radar gives you direct range data; camera pixels need to be processed by ML to infer range data, and the latter is never going to be as close to ground truth as the former, so the former should be prioritized.
Re:Andrej Karpathy: Why Tesla Removed Radar and Ultrasonic S... by Nomentatus on Sunday October 30, 2022 @09:15PM (#33400897)
Not quite. Light waves are so short you'll get some return from almost any surface. This isn't true of radar, and it's not just what substance the outbound radar hits but how flat it is, too. You may get no return. Or almost none. Even round posts give very little return IIRC. There's also an echo problem with long waves such as sound and radar, particularly in urban areas. In which case what you think is a firm direct return may be a very indirect return that happens to be in synch with the signal you were expecting.
Re:Andrej Karpathy: Why Tesla Removed Radar and Ultrasonic S... by touch_abs on Sunday October 30, 2022 @10:39PM (#33401465)
Its interesting, that kind of object level fusion is a fairly different problem to training visual perception, following some of the less in fashion robotics techniques. I wonder if its a case of the Tesla engineers focusing on the fad technologies (or just their strengths) more than its a hardware cost thing.