Re:Building the Software 2.0 Stack by Andrej Karpathy [video]
by tzahola on Monday June 11, 2018 @08:16AM
(#17283604)
>One or two fixed position monochrome, low resolution forward facing cameras such as in a Tesla just won't compare.
I'm pretty sure humans could cope with that. https://www.youtube.com/watch?v=-CITIXlw_T4
Re:Building the Software 2.0 Stack by Andrej Karpathy [video]
by Animats on Monday June 11, 2018 @12:21PM
(#17285616)
I'm surprised that Tesla isn't doing stereo or trinocular (3 cameras) to get depth. It's just cameras, and it works reasonably well. You can use cameras the width of the windshield apart to get a wide baseline, which increases the useful range. But no. Although Tesla does have multiple cameras, they never mention stereo vision. Mobileye is depth from motion, and apparently, so is Tesla's in-house system.
(3-camera depth is more reliable than 2-camera. Many of the ambiguous situations for two cameras can be resolved with three. Especially if it's 3 cameras in a triangle, not a line.)
Re:Building the Software 2.0 Stack by Andrej Karpathy [video]
by unityByFreedom on Monday June 11, 2018 @09:00PM
(#17289943)
> Mobileye is depth from motion, and apparently, so is Tesla's in-house system.
Monocular depth perception w/out motion is a thing too, e.g. [1], however I doubt it is good enough for safety-critical systems like self-driving cars.
Edit: not to mention state-of-the-art sensor fusion, with atmospheric composition analyzer, thermometer, multiple high resolution vibration sensors, stereo microphones and an advanced vehicle to vehicle signalling system backed by heuristic fallbacks.
One or two fixed position monochrome, low resolution forward facing cameras such as in a Tesla just won't compare.
I'm not saying it can't be done, but the Tesla engineers have a much harder task than if they'd had human level sensors. The Tesla "brain" is more like a human looking out of a tank through a periscope in a tank or something... and the periscope can't even be turned.