News for hackers. Stuff that matters.
Re:Statement on AI Risk by acjohnson55 on Tuesday May 30, 2023 @08:34AM (#36124062)
Extinction would probably require an AI system taking human extinction on as an explicit goal and manipulating other real world systems to carry out that goal. Some mechanisms for this might include:

- Taking control of robotic systems

- Manipulating humans into actions that advance its goal

- Exploiting and manipulating other computer systems for greater leverage

- Interaction with other technologies that have global reach, such as nuclear weapons, chemicals, biological agents, or nanotechnology.

It's important to know that these things don't require AGI or AI systems to be conscious. From what I can see, we've set up all of the building blocks necessary for this scenario to play out, but we lack the regulation and understanding of the systems being built to prevent runaway AI. We're playing with fire.

To be clear, I don't think I am as concerned about literal human extinction as I am the end of civilization as we know it, which is a much lower bar than "0 humans".

Re:Statement on AI Risk by endisneigh on Tuesday May 30, 2023 @08:36AM (#36124073)
everything you're describing has been possible since 2010 and been done already. AI isn't even necessary. simply scale and some nefarious meat bags.
Re:Statement on AI Risk by acjohnson55 on Tuesday May 30, 2023 @12:22PM (#36126734)
I don't disagree. But I believe AI is a significant multiplier of these risks, both from a standpoint of being able to drive individual risks and also as a technology that increases the ways in which risks interact and become difficult to analyze.