News for hackers. Stuff that matters.
Re:For AI to thrive, it must explain itself by jes on Sunday February 18, 2018 @04:08PM (#16408664)
I don't think AI needs to be able to explain itself in order to be trusted. Human beings, in general, cannot give arbitrarily deep and valid explanations for their actions, and yet, somehow, we manage to come to trust them.
Re:For AI to thrive, it must explain itself by throwaway2048 on Sunday February 18, 2018 @04:32PM (#16408839)
That's true, but in general humans are concerned about the consequences of their actions and are metacognitive about them, or at the very least can be punished for making the wrong choices, its an iterative corrective process.

How do you apply the same logic to a neural net? It has no comprehension of desirable outcomes, or what its choices actually entail and never can.

There is no way to tell a neural net that a human is not a signpost directly, so it knows in the future no humans are signposts. The only thing you can do is train it on a larger data set and hope it "gets it".

You can tell a human being that a human is not a signpost once, and they can abstract it to all situations.

Re:For AI to thrive, it must explain itself by jpindar on Sunday February 18, 2018 @10:24PM (#16410542)
Hell, you can't even tell them that a red octagon on a post with the letters S T O P on it is a stop sign.