News for hackers. Stuff that matters.
Re:Andrej Karpathy: Why Tesla Removed Radar and Ultrasonic S... by snovv_crash on Monday October 31, 2022 @02:54AM (#33402745)
In order to display the gravity-aligned acceleration, sensor fusion between gyro and accelerometer has to occur. This is typically done with a Kalman filter, and runs on 1960s levels of hardware. If you look at something like a drone autopilot, eg. Ardupilot, the sensor fusion is soo cheap that they even extended the Kalman filter to also estimate things like the sensor bias offsets and earth's magnetic field vectors.

Sensor fusion is computationally cheap. It's just a lot of R&D to do it in a way that leads to a net gain in precision and robustness.

Re:Andrej Karpathy: Why Tesla Removed Radar and Ultrasonic S... by 01100011 on Wednesday November 02, 2022 @08:22PM (#33444912)
We're talking about radar and ultrasonic sensors here, not accelerometers. We're also talking about feeding them to a deep neural network. Not the same thing. Sensor fusion is not being done with a Kalman filter in this case.
Re:Andrej Karpathy: Why Tesla Removed Radar and Ultrasonic S... by snovv_crash on Friday November 04, 2022 @08:59AM (#33465843)
Radar and ultrasound both give drastically less data than a simple 720p webcam. After postprocessing their output bandwidth is more similar to a 9-axis IMU than a camera.
Re:Andrej Karpathy: Why Tesla Removed Radar and Ultrasonic S... by 01100011 on Sunday November 06, 2022 @01:39PM (#33495691)
Yes and each time you process the incoming camera data in the neural network you have extra calculations due to the sensor fusion with another data source, regardless of its bitrate. Have you worked with deep learning much?