https://www.weather.gov/media/publications/front/14dec-front...
My father was a missile radar guidance technician for a living. He says radar on a car makes almost no sense, especially for navigating in inclement weather, due to how radar tends to reflect off of anything to some degree.
Every sensor, man-made or natural, sucks at detection when it comes to operating in heavy inclement weather. That's why we need tons of processing power and filtering algorithms. If they were any good, we'd not need those higher-order algos and filters. The sensors could simply generate reliable data.
Automotive radar are in the ~80ghz range, giving it a wavelength on the order of about 4mm. Car radar can definitely see through rain and snow. All radars receive a range of reflections from many objects, rain included, but the return off of rain is nothing compared to the return off of a solid object. The filtering then becomes choosing the peak amplitudes of the radar return signal. Rain will manifest itself as a smearing of the signal and lowering the peak a little bit, but usually much less than a solid object.
Optical and lidar work miserably through rain/fog, with wavelengths in the ~1000nm range, but have much higher resolution.
Any real self-driving solution in the near to medium future is going to involve sensor fusion of as many sensors the car manufacturers can afford and cram in. This means cameras, ultrasound, lidar, radar, etc. Anybody telling you that there is only one true sensor to rule them all is either selling you something or ignorant of the state of the industry
isnt that what a kalman filter does? I thought most autonomous cars have sensor fusion to blend all sensors
That works quite well for, say, combining GPS (which has short-term noise) with inertial/odometry measurements (which suffer from long-term drift) to determine your vehicle's position, orientation, and velocity in 3D space (expressible as a 9-dimensional state vector). But it's not directly applicable to problems like combining map data with LIDAR and vision to generate a representation of your surroundings.
This is a misunderstanding. Lichess is used by chess professionals for playing online chess against each other (which is mostly recreation and not serious chess preparation). Software like ChessBase is used for game preparation.
Humans are actually using their ears a LOT while driving. You don't realize it because the brain is so powerful at blending everything into a single "feel".
While the brain can still operate a car with the loss of some input, visual input isn't really enough and is heavily supported by all other senses (acceleration and gravity, sound, touch and vibration, temperature and kinesthetic). Unlike modern computers, the brain is massively parallel and asynchronous, so it can simply use all of the inputs to find the correct course of action, even going as far as considering multiple lines of thoughts (and then your memory is manipulated so you only experience the chosen line of thought, similar to your vision being manipulated when you blink).
The brain is using hundreds of different captors and is order of magnitude more powerful than any computer today. Attempting to drive with a couple cameras as only sensors is a recipe for disaster as has already been proved (see also: Tesla crashes)
We do this as humans. We use our ears for sound and inertial detection.
Lidar, Radar, colour and near infrared optical all have a place in autonomous driving.
I dont think we are really anywhere near optical working reliably as a single source. I am immediately suspicious of anyone who suggests otherwise, because they either believe to much in the state of AI, or haven't thought enough about life critical systems to be let near anything autonomous. Worse still, they may be out to make a quick buck.
The thing that lidar has is speed and accuracy. 100hz update rates, and 1/100th second latency is not unthinkable. With optical systems you're lucky to get 25hz with sub 100ms latency. Thats just for depth estimation using semantics, you still need to feed it into your driving model.
Lidar works way better at night, it works a tonne better with unknown objects. However, like optical its shit in rain/snow. Hence why decent resolution radar will be needed as well.