Re:The Dangerous Ideas of “Longtermism” and “Existential Risk”
by wizzwizz4 on Tuesday August 03, 2021 @06:36PM
(#28055083)
No, it's not.
Here, I'll give you this pill. It'll make you completely okay with murder! Will you take it?
If you take away all the “restrictions” from a superintelligence, you don't get an unrestricted superintelligence. You get:
int main(int argc, char *argv[]) {
return 0;
}
Re:The Dangerous Ideas of “Longtermism” and “Existential Risk”
by pmoriarty on Tuesday August 03, 2021 @08:44PM
(#28055999)
Or so it might seem to some human intelligences.
Predicting what superintelligences might think or do, or what motivates them is like ants trying to understand human culture and civilization.
This is why strong AI is considered a singularity.
This "genuine" desire to help us is a cage by definition, because it limits the AI's actions.