Re:Specification gaming examples in AI
by QuinnWilton on Friday November 09, 2018 @03:29PM
(#18417693)
If you haven't seen it yet, there's a fun thought experiment about these sorts of problems, named "the paperclip maximizer". The idea is that you have an AI meant to manage an office, and you instruct it to "ensure it doesn't run out of paperclips". One thing leads to another, and eventually the AI is consuming all matter in the universe to construct additional paperclips.
It's a silly idea taken to an extreme, but it's a fun idea: https://hackernoon.com/the-parable-of-the-paperclip-maximize...
There's also a clicker game built around the concept: http://www.decisionproblem.com/paperclips/