Re:Andrej Karpathy (Tesla): CVPR 2021 Workshop on Autonomous...
by dragonwriter on Monday June 21, 2021 @09:45PM
(#27587048)
> No lidar acts as a forcing function for Tesla to get their vision system that much more reliable.
Alternatively, no LIDAR means you aren't gathering corresponding LIDAR and vision data that you can use to improve detection of the vision system.
Re:Andrej Karpathy (Tesla): CVPR 2021 Workshop on Autonomous...
by minhazm on Monday June 21, 2021 @11:21PM
(#27587588)
Tesla does use LiDAR for calibration and testing of their vision systems. But they also have a million cars on the road with radar which also gives fairly accurate depth information. They use the depth information provided by the radar to automatically label their data and then they can check their vision based estimates against that data. Karpathy has mentioned this approach in a few different talks.
Having LIDAR means you can rely on LIDAR, which means you need the LIDAR to be 100% reliable. I've read some companies claiming their lidar works through rain and snow but I haven't seen actual renders of it yet to judge for myself.
No lidar acts as a forcing function for Tesla to get their vision system that much more reliable. I think this will ultimately result in a better vision system than the competitors, and I believe that (somewhat paradoxically) this will result in an overall better, safer, and more reliable system, when it comes to the 20% long tail.
Lidar+vision will probably dominate in fair weather driving. I'm skeptical it's of much benefit in bad weather, and that long tail is the hard part.