Re:Yann LeCun: AI one-percenters seizing power forever is re...
by espadrine on Thursday November 02, 2023 @07:02AM
(#38111709)
Thanks for summarizing this argument. You can adapt it with many other entities whose risk is in practice managed. Replace the entity with “super-intelligent humans,” “extra-terrestrials,” “coronaviruses with higher incubation and mortality,” “omnivorous ant swarms”…
1. <Entity> are possible.
2. Unaligned <entity> are an existential risk likely to wipe out humanity.
3. We have no idea how to align <entity>.
What those example entities have that AGI doesn’t, is self-reproduction, a significant and hard (in the sense of Moravec’s paradox) achievement for a species to have, yet one that significantly increases its survival probability.
1. <Entity> are possible.
2. Unaligned <entity> are an existential risk likely to wipe out humanity.
3. We have no idea how to align <entity>.
What those example entities have that AGI doesn’t, is self-reproduction, a significant and hard (in the sense of Moravec’s paradox) achievement for a species to have, yet one that significantly increases its survival probability.