News for hackers. Stuff that matters.
Re:AlphaGo Beats Lee Sedol in Final Game by mikeash on Tuesday March 15, 2016 @12:05PM (#11290632)
I like the Paperclip Maximizer thought experiment to illustrate this:

https://wiki.lesswrong.com/wiki/Paperclip_maximizer

Short version: imagine you own a paperclip factory and you install a superhuman AI and tell it to maximize the number of paperclips it produces. Given that goal, it will eventually attempt to convert all matter in the universe into paperclips. Since some of that matter consists of humans and the things humans care about, this will inevitably lead to conflict.

There are no comments on this comment yet.