News for hackers. Stuff that matters.
Re:The Reluctant Prophet of Effective Altruism by gnramires on Tuesday August 09, 2022 @11:50AM (#32399553)
Indeed not only fluid, but also open to criticism. I've been always quite unsure of how to quantify AI risk. My conclusion at the moment is that it's a complex risk. I don't think singularity is plausible in any way or FOOM.

Still, the changes to society are absolutely hard to grasp. Humans may face (economical) obsolescence in a few decades[1] (humans need not apply[2]). That puts us in a delicate situation: if humans are economically obsolete, a society that only values economic value (and not consciousness per se) will have all reasons to slowly but surely get rid of humans (and animals).

We need a revolution of meaning and ethical understanding: the understanding of the fundamental value of consciousness, and to structure our lives and all institutions around it (each individual needs to have a good understanding of such ethics and meaning so that society as a whole is robust). I think formalization of ethics (which I'm a proponent of) and progress in metaphysics is going to contribute as well to this end. I think EA is simply part of this new understanding of ourselves and the Universe, a sort of coming out of a dark age -- and there's the opportunity to create a lasting society amazing for everyone.

[1] My personal guess-estimate is about 50(-20/+40) years to complete obsolescence, although various researchers have wildly different estimates.

[2] https://www.youtube.com/watch?v=7Pq-S557XQU

There are no comments on this comment yet.