The "real-world driving data" is what I'm calling the "raw data" here, as it's the raw data from the standpoint of the (perceived) AI algorithms driving self-driving cars.
> Tesla is the only one going all-in on vision based self driving. That's the key thing that's going to get us to full self driving.
Why is it the key thing? Why should worsening the quality of your input data improve the results?
Our eyes get worse data than lidar, yet our brains are able to process this data more effectively.
Also, lidar is super expensive. It will take much longer to get affordable lidar into everyday vehicles.
Running with a more responsible hardware stack means the software has to be more cleverly designed, and that design is mostly not in the just-throw-data-at-a-neural-net stage. Building your visible-light-only driving system is going to cause you to struggle a lot harder at getting a good subroutine for "how far away is that object?" while providing you no benefit to solving the harder problem of "what will that object react to my coming nearer to it?"