Re:The Dawn of AI: How to ensure the promise outweighs the p...
by xamdam on Thursday May 07, 2015 @04:53PM
(#9508234)
The default outcomes are bad; Culture would be pretty great by comparison.
Worst-case scenarios are not likely for the same reasons best ones aren't - the default is AI indifference (they use you for atoms)
Since you mentioned worst, this is a must-read-classic :) http://hermiene.net/short-stories/i_have_no_mouth.html
http://en.wikipedia.org/wiki/The_Culture
Vinge and Stross both hint at the worst cases - and they would be pretty bad, simply having using atoms re-purposed might not look that bad by comparison:
"There is life eternal within the eater of souls. Nobody is ever forgotten or allowed to rest in peace. They populate the simulation spaces of its mind, exploring all the possible alternative endings to their life."