Re:Sometimes, requiring explanability is counterproductive
by lars on Friday February 07, 2020 @05:35AM
(#22264747)
I am very aware of these, and I like methods like CLRP. It's great to have these tools to debug neural networks.
However, for many that argue for explainable AI, CLRP falls way short of what they want. In particular, the symbolic AI crowd would scoff at it. This is the crux of the issue in my eyes, that the symbolic AI crowd has taken "explainability" as a way to justify methods that don't work.
I have no issue with methods that allow greater understanding of neural net internals, that's essentially what all neural net researchers spend all their time on (and it's the path towards better performing methods).
Re:Sometimes, requiring explanability is counterproductive
by naresh_xai on Wednesday February 19, 2020 @02:54AM
(#22363804)
Interested in seeing where symbolic AI crowd has disagreed with that. Only group of people who disagree that I know of are a small set of people who think you should build inherently explainable models as opposed to explaining the decisions of deep neural networks.
Contrastive LRP would be a good starting point for you for generating high fidelity explanations at any point in the network.