try
{
while (true)
{
if (IsScenarioOutsideOfUnderstanding())
{
throw NotUnderstoodException()
}
}
}
catch (NotUnderstoodException)
{
SlowDownAndStopLikeAnyoneElseWould();
} Patch for car stopping way too often:
catch (NotUnderstoodException)
{
- SlowDownAndStopLikeAnyoneElseWould();
+ // FIXME TODO let the safety driver handle it for now
+ // SlowDownAndStopLikeAnyoneElseWould();
}Specifically, he shows an orders-of-magnitude chart, each point accompanied by a picture of a car presented at that magnitude of occurrence. At one extreme is "car" as they appear with most common frequency (in front of you, rear visible). At other extreme is "car" in an extremely unlikely occurrence (airborne, bottom view prominent). The system Tesla implements addresses such a broad range of information & occurrences.
Tesla has upwards of a million "full self driving" vehicles on the road now, all gathering video, all processing that data, all feeding what they learn & experience back to Tesla. The computers, even if not actually driving, are constantly observing situations, categorizing, and comparing to what humans do as a response. Extreme situations (crashes etc) are flagged and routed to Tesla for incident analysis; the AI is corrected & taught to handle the situations, and all vehicles updated accordingly in short order.
Upshot: Tesla DOES have a system for addressing, learning, encoding, and improving the "thousands of other" scenarios. By the time "full self driving" is unleashed, the Tesla AI system will already be trained to extremes by a million "trained, experienced, and attentive drivers"; insofar as some cases may be insufficiently covered, they will be statistically less common & dangerous than the baseline error rate of human drivers (distracted, drunk, debilitated, dumb).
As far as accountability, Tesla is working hard to build a decisive system & case that if bad happens, it is a statistical anomaly which is still better than the alternative of not using self-driving tech. There is a legal principle whereby one may violate the law when obeying it would cause greater harm; autonomous vehicles are close to crossing that line for the better.
And yes, great profit is due those who improve humanity via technology.
I'm curious how you square this with the fact that humans learn to drive with intermittent sensory input from only two cameras plus some auxiliary sensors. Clearly, humans can extrapolate from very limited input. Why can't Tesla demonstrate object permanence after years of development?
There are no simple answers to the above questions, but if a driver causes the accident, they are accountable. Companies want to launch this tech but not own accountability for accidents when it could well be faulty logic and or code that contributes to deadly incidents. In a ship... less of a risk... In a car, surrounded by 4-10 other cars, the risk is much higher.
Profit making should not drive this blatant hubris... We forget how history reminds us of an over-reliance on technology and intelligent design.