If Tesla (or any self driving player, but the Tesla FSD stack drives a million miles/day across the US right now) published a road quality score, home buyers would quickly start paying attention and then home owners would quickly start paying attention. This would push forward the political will to fix the roads, at least in places where low road quality is driven by budgeting problems rather than outright poverty.
I think most people would argue that the taxes they're paying now should cover it and if that's not enough we could try things like diverting tax money from waste, eliminating earmarks, or maybe even start forcing corporations and billionaires to pay their fair share. People want nice roads and are willing to pay taxes for it, but the burden shouldn't fall entirely on the shrinking middle class.
You use way more than two vision sensors in your head. But first, lets talk about those vision sensors. They are mounted on an articulated scanning platform with numerous degrees of freedom. The dynamic range is astounding, and that dynamic range can be easily augmented with shaded lenses that can be mounted and removed as needed via an extremely reliable pick-and-place mechanism. The vision sensors are really equipped with dual-sensing technology for day- and night-mode.
But, you also have extremely sensitive accelerometers in your ears. And force-sensing in your feet to measure applied acceleration/braking controls. And force-sensing in your hands to measure applied steering force, and measure road roughness. You also are sitting on a force sensor that serves as a back-up accelerometer. You have audio sensors that provide feedback about road surface, vehicle performance, and other agents sharing the road.
Yeah, that kind of agent prediction is a biggie. Agent prediction is something journalists don't talk about much, but is a huge research topic for AV practitioners.
And since you make note of expected behavior of objects... my all-time favorite bug report out of Waymo (that made the public news) is a classic classifier/predictor/planner corner case leading to deadlock. Classifier identified a cyclist and labeled as "stopped" if cyclist has foot on the ground, and "moving" if both feet on pedals. Predictor would plot a trajectory for moving cyclist, planner decides action based on predicted agent behavior. So... Waymo vehicle and cyclist on two corners of 4-way stop. Cyclist is stopped, doing a perfectly balanced track stand with both feet clipped in. Feet on pedals so cyclist is labeled as moving agent... planner yields right-of-way to cyclist according to rules-of-the-road. Deadlock -- nobody moves.
She was homeless so the shape of her bike wasn't a proper bike so it got confused.
Very different circumstances. I don’t think this was a classifier defect. Not that I was ever a fan of Uber’s development program, but in this case I can’t fault the platform.
Most automobiles don't run on legs and airplanes are not flapping their wings either.
After all does anyone care if the plane they are in is flapping its wings?
Firetruck >_____________< Fire Hydrant
Something that looks flat but is actually a fire hose means you should stop instead of driving over it - this was actually issue in Phoenix(?)
A homeless lady was killed by a self-driving car. She was walking a loaded bicycle, at 2am, on a road that doesn't usually have pedestrians. The self-driving car couldn't decide if she was a bike or a human so it didn't brake and the human-driver backup had zoned out as the car had made 99.99% of the correct decisions.
A self-driving car is like a jigsaw puzzle - there's one way to do it right, and infinite ways for it to be completely or subtly wrong.
"What do you see" and "What does it mean"
Humans and cameras have the same "What do you see" input, but the "What does it mean" category hasn't been conquered by cars.
It's great that we have cars that can warn us when there's something in our blind spot, something behind us while we back up, or when we drift out of our lane. Until the software can perform as well as we can, any more than that is a liability.
That isn't quite right. There can be situations where the human is better, so long as in the majority of situations the machine is better. This is why I said it is a statistical question. I'm not demanding perfection, I'm asking for better than humans overall. Of course if the machine knows it is in a situation where it isn't as good it is fine to make the human drive.
Most roads aren't even properly painted ._.
Hence, either /you/ drive, or /the car/ drives. If the car doesn't understand what is going on, it should stop. (Humans really suck at monitoring boring, monotonous processes. We cannot expect people to do so in a self-driving car for hour after hour on the off chance something happens.)
I don't mean so people can navigate; I mean so people can complain to a city or district when a road is improperly marked.
But the vast majority of the difficulty in autonomous driving is simply dealing with the messiness of the real world. For example, many of the most serious and notable autonomous driving crashes have been the result of faulty road conditions (e.g. https://www.theverge.com/2020/2/25/21153320/tesla-autopilot-... - in that case, the driver wasn't paying attention, but the fact that lane markers were worn down is what caused Autopilot to lose lane tracking, and the fact that crash attenuator in front of the barrier was damaged and not replaced contributed to the driver's death).
Government can't even keep decent lane lines on the roads, and thus I think an autonomous driving system that had to depend on magnets or radios (that failed if those were out) would be even more of a non-starter.
If you had this, driving period would be safer, automated or not. And that's before getting into inclement weather conditions where, say, lines or signage may not be visible.
What I'm getting at is, there's no reason to assume that the current amount of information presented on a roadway (stripes, lights, stopsigns, etc.) is sufficient for autonomous driving. Or maybe it is, but adding a few more inexpensive things would make it that much easier to achieve.