So, speculatively, it is a double failure:
1) Trailer was high enough to avoid radar
2) Trailer was light enough/low contrast to avoid detection by the camera
I hope Tesla learns something from this, from the outside looking in - they appear to have a cavalier, can-do attitude (nothing wrong with the latter) towards safety engineering. Release beta self-driving software to production vehicles? Yeah, why not?
What if a deer crosses the road? Will the car hit the deer to save the life of the driver? Avoid the deer to avoid an accident? Or save the deer and run into the ditch, possibly harming the driver?
Unfortunately, this technology is not capable of making those decisions and if ultimately the driver is responsible, then maybe we should just keep it that way then.
This is not even a slight morality issue. The person is more important than the deer.
"Unfortunately, this technology is not capable of making those decisions"
Of course it is. Program the machine so that its primary concern is protection of human life. Which should be its secondary concern (protection of property or protection of deer) is a more interesting question. But running into the ditch to save the deer while threatening harm to the driver is simply not an option.
> What we know is that the vehicle was on a divided highway with Autopilot engaged when a tractor trailer drove across the highway perpendicular to the Model S. Neither Autopilot nor the driver noticed the white side of the tractor trailer against a brightly lit sky, so the brake was not applied.
Failing to detect the white side of a tractor against a brightly lit sky is something I can see camera/image based sensors struggling with, but not LIDAR based sensors.
[1] https://www.teslamotors.com/blog/tragic-loss