Re:Google's AutoML: Cutting Through the Hype
by visarga on Thursday August 02, 2018 @01:36AM
(#17669425)
You can't make a full on model audit on a neural net, but there are architectures such as the Transformer (an attention scheme) that can give a lot of insight into what the neural net thinks. We can also visualise what inputs maximally activate a deep neuron in a CNN. Not all DL models are truly black boxes.
[ Parent
| on HN ]
Re:Google's AutoML: Cutting Through the Hype
by AstralStorm on Thursday August 02, 2018 @04:05AM
(#17669940)
The problem is the models have no reflection capabilities unlike people.
The explanation is always done by a really different external system and sometimes by an actual intelligence.
State models (Markovian) are sometimes able to explain things but not always really, especially in complex cases.