Re:The Reluctant Prophet of Effective Altruism
by Noosphere89 on Thursday August 11, 2022 @02:11PM
(#32429648)
This. Trying to explain why mesa-optimizers are a problem, why deception is common, and instrumental convergence harms humanity is quite complicated, and any proper explanation can't be told to a 5 year old.
No and anyone who tells you otherwise is wrong.
A proper understanding of AI risk is a very thick book.
There are a ton of normally useful intuitions, heuristics and habits of thought that are implicitly applied when understanding the world that DON'T apply in the AGI case.
It cannot be explained to a five year old.