Re:Why Did the Robot Do That? Increasing Trust in Autonomous...
by Cafey on Tuesday December 06, 2016 @08:47AM
(#13114505)
>But even humans do things that they can't explain
That is actually very interesting. I would even extend that sometimes, humans know the decision they are making is stupid/not the right one but the reward for taking that bad decision is worth it for him. Translating that flawed behavior into an AI must be terribly hard.
Re:Why Did the Robot Do That? Increasing Trust in Autonomous...
by TeMPOraL on Tuesday December 06, 2016 @09:00AM
(#13114581)
Moreover, often humans seemingly "can't explain" something - or invent nonsense explanations - because the act of actually explaining their reasoning could expose them to bad consequences, often social ones.
Question: why didn't you tell me you're going to a meetup after work?
Provided explanation: because I was so busy I forgot about it.
Real explanation: because I didn't want to have a conversation about it with you.
When the AI(robot) decision is similar to a human daily thought, the difficulty is low. But even humans do things that they can't explain, and come with a later explanation that doesn't fulfill what just happened. When spurious correlations are found by AI, translating it to human understanding (not just language) will be very hard.