News for hackers. Stuff that matters.
Re:Thoughts on OpenAI, reinforcement learning, and killer ro... by jacquesm on Friday July 28, 2017 @07:55PM (#14878550)
Re:Thoughts on OpenAI, reinforcement learning, and killer ro... by dxbydt on Friday July 28, 2017 @08:07PM (#14878617)
Not quite. Another popular example is the cnn learning to distinguish wolves from non-wolves, because the wolf was always photographed on snow & the other animals not on snow. It just learnt to distinguish snow vs non-snow instead of wolf vs non-wolf. It then failed catastrophically when you put a non-wolf on snow.

There's no leakage in either case. The model is learning one thing and you think it's learning another.

Re:Thoughts on OpenAI, reinforcement learning, and killer ro... by rw on Friday July 28, 2017 @08:45PM (#14878791)
No, it's called insufficient feature engineering. Data leakage is when your test data contaminates your training data.
Re:Thoughts on OpenAI, reinforcement learning, and killer ro... by uptownfunk on Saturday July 29, 2017 @04:34AM (#14880235)
Actually this is a clear case of overfitting leading to a high false positive rate resulting in the misidentification of a US ship for chinese.
Re:Thoughts on OpenAI, reinforcement learning, and killer ro... by kgwgk on Saturday July 29, 2017 @06:08AM (#14880460)
I don't think that's a clear case of overfitting. You could have used a subset of the original data for training and the rest for validation and it would have generalised pretty well.

It doesn't generalise when the US ship is in Chinese waters, but that's because the system was never "learning" to recognize ships in the first place.