Re:Inside Darpa’s Push to Make Artificial Intelligence Expla...
by nl on Friday August 11, 2017 @01:29AM
(#14986802)
But the notion of "Explainable AI" just reeks of upper middle management folks performing what they see as visionary risk management.
AI says: "kill this person".
If it's only "upper management folks" asking "why" then I'm all about that visionary risk management!
Hell, I debug machine learning models every day, and most of my time is spent around working out "why". And the answer "it's just fitting the training data" is often wrong, insufficient, or misleading.
For example, I'm currently working on a sentiment-related task, and there's a particular class of misclassification where the model isn't taking the context of a word into account sufficiently.
In this case, the data is fit nicely, but the features it is fitting to don't contain the context. By adding tri-grams I can capture the context sufficiently to avoid this problem.
AI says: "kill this person".
If it's only "upper management folks" asking "why" then I'm all about that visionary risk management!
Hell, I debug machine learning models every day, and most of my time is spent around working out "why". And the answer "it's just fitting the training data" is often wrong, insufficient, or misleading.
For example, I'm currently working on a sentiment-related task, and there's a particular class of misclassification where the model isn't taking the context of a word into account sufficiently.
In this case, the data is fit nicely, but the features it is fitting to don't contain the context. By adding tri-grams I can capture the context sufficiently to avoid this problem.