Re:Why we downplay Fermi’s paradox
by resu_nimda on Tuesday August 07, 2018 @06:11PM
(#17711336)
I guess I just don’t share your belief that strong AI is necessarily equivalent to a paperclip maximizer that will seek to assimilate all available resources into one monolithic mass.
Do the humans have any say in this, any control? If not, how/why are they being kept alive? Again, even if the AI is so myopic that it won’t spare any resources to expand into other systems, the humans will still want to.
Yeah it is. That's the assumption right from the start here, embodied in "strong AI" and that I've repeatedly and explicitly referred to throughout including a reflection on why it might be consciously avoided and whether that could work too. A strong AI could grow to use any amount of available computational and memory capacity, and might well need to in order to accomplish some things. There would certainly be advantages to having a higher degree of thought possible. That's the whole question raised by the OP of this thread.
Again, if you want to instead theorize why strong AI might be explicitly avoided by a civilization that's fine, but that's not the premise I was replying to originally is all.