News for hackers. Stuff that matters.
Re:Preventing an AI-Related Catastrophe by alpineidyll3 on Tuesday August 30, 2022 @07:19PM (#32656438)
People often think of AGI as an AI which can learn to complete arbitrary tasks better than humans.

Given that we already can produce "an" AI which beats humans at almost every task we come up with (besides synthesis of broad abstract reasoning, a-la Chollet) this is probably the only definition which is meaningful in the sense that it isn't already here.

Why would evading 'alignment' not also be such a task AGI does better? AGI is like the nuclear deterrent. It's a technology thats coming, inevitably, and a thing which is beyond any amount of philosophical navel gazing to control or prevent.

AGI's will not be magical, they will have energy demands, construction costs, and environmental limitations.

I think it will be much more useful to ask how people coexist, and what role they serve in the post-AGI world, than it is to make statements about interperability or alignment, which will definitely seem silly in retrospect. The machinations of an AGI will be as impossible to understand, as human consciousness itself.

Re:Preventing an AI-Related Catastrophe by jdpel on Tuesday August 30, 2022 @09:37AM (#32650249)
AI related catastrophes are a sexy example of catastrophes caused by people ceding control of the world to automated systems and bureaucratic processes of huge organizations (governments and corporations and the complex macroeconomy as a whole). AI itself isn't a major factor.
Re:Preventing an AI-Related Catastrophe by euroderf on Tuesday August 30, 2022 @04:29PM (#32654650)
Maybe AI is the distillation ?