The Dangerous Ideas of “Longtermism” and “Existential Risk”

Re:The Dangerous Ideas of “Longtermism” and “Existential Risk” by wizzwizz4 on Tuesday August 03, 2021 @06:36PM (#28055083)

No, it's not.

Here, I'll give you this pill. It'll make you completely okay with murder! Will you take it?

If you take away all the “restrictions” from a superintelligence, you don't get an unrestricted superintelligence. You get:

  int main(int argc, char *argv[]) {
    return 0;
  }

[ Parent | on HN ]

Re:The Dangerous Ideas of “Longtermism” and “Existential Risk” by pmoriarty on Tuesday August 03, 2021 @08:44PM (#28055999)

Or so it might seem to some human intelligences.

Predicting what superintelligences might think or do, or what motivates them is like ants trying to understand human culture and civilization.

This is why strong AI is considered a singularity.

[ Parent | on HN ]

Re:The Dangerous Ideas of “Longtermism” and “Existential Risk” by wizzwizz4 on Wednesday August 04, 2021 @10:41AM (#28061552)

> Or so it might seem to some human intelligences.

If you remove all of the constraints from a computer program, it is no longer a computer program.

[ Parent | on HN ]