Although this doesn't involve machine-learned models, this story highlights the worth of good human judgment, something that currently isn't replicable in machines.

http://en.wikipedia.org/wiki/Stanislav_Petrov