Sorry, I disagree. If you can see why you need to hear also? Seeing will give you more insight (size, speed, clear distance etc). A sound will give you none of that. You can get some clue about distance from sound but it may not be entirely accurate.
There is a device that does all of that complete flawlessly, consumes single watts, requires no exotic materials, costs few dollars in mass production, fits on a business card, and is manufacturable in millions.
It's called radar. Accentuation on just anything else is the best proof that they never took the task seriously.
Would that still be true if you had eyes pointed in all directions? Hearing is 360 degrees, and so is automotive vision/lidar.
Computers definitely have less latency for audio than video, what with audio waves having many thousands of hertz while for video anything over 120fps is high speed.
Speed of sound is ~350m/s. So, whatever you're processing in 1/120th of a second is sound that was only like 10 feet away.
As an outsider to this space, it’s always puzzled me that Elon constructs a dichotomy between lidar-based and vision-based self-driving.
I find that I rely on my hearing nearly as much as my eyesight. Especially to detect dangerous conditions that demand quick decisions, I find that hearing is the most important of the senses.
Does anyone know the extent to which microphones and audio processing feeds into Tesla or Waymo or other self-driving systems?