Re:Explainable Artificial Intelligence (XAI) Darpa Funding
by Houshalter on Thursday September 08, 2016 @07:32AM
(#12452047)
Whether or not we can ever come up with a good definition of "explainability", I still think it's misguided. In almost all applications of ML, accuracy matters far, far more. Predicting whether a patient has cancer, for instance, it matters a great deal that you get the highest accuracy possible. Every point in accuracy you lose to "explainability" means people die.
Re:Explainable Artificial Intelligence (XAI) Darpa Funding
by romaniv on Thursday September 08, 2016 @10:43AM
(#12453438)
Until your model starts misdiagnosing people in real life because your training data wasn't 100% perfect (which it never will be for complex real-life problems).
The problem with unexplainable AI isn't just the lack of explanations. It's the fact that the entire model is a black box, so you cannot somehow tweak a single part of it without retraining.
Do you think people should stop working on it?
Most interesting things seem difficult to measure, until someone finds a way, and then it seems obvious. An example is search engine quality. At first this might seem too subjective to be measurable. But Google started measuring search quality using a panel of humans, and now everybody does that.
The whole idea of these challenges is to broaden the search, to hope for key insights that by their nature seem elusive at first.