There is always the tank story/myth http://neil.fraser.name/writing/tank/. Of course, that is more about how a neural network might not be training itself in the way you expect.