Yann LeCun: AI one-percenters seizing power forever is real doomsday scenario

Re:Yann LeCun: AI one-percenters seizing power forever is re... by TeMPOraL on Thursday November 02, 2023 @07:50AM (#38112156)

Nukes don't have a mind of their own. They're operated by people, who fortunately turned out sane enough that they can successfully threaten each other into a stable state (MAD doctrine). Still, adding more groups to the mix increases risk, which is why non-proliferation treaties are a thing, and are taken seriously.

Powerful enough AI creates whole new classes of risks, but it also magnifies all the current ones. E.g. nuclear weapons become more of an existential risk once AI is in the picture, as it could intentionally or accidentally provoke or trick us into using them.

[ Parent | on HN ]

Re:Yann LeCun: AI one-percenters seizing power forever is re... by RandomLensman on Thursday November 02, 2023 @08:18AM (#38112462)

AI could pose those risks, but it also could not - that is the difference to nuclear weapons.

[ Parent | on HN ]

Re:Yann LeCun: AI one-percenters seizing power forever is re... by TeMPOraL on Thursday November 02, 2023 @08:40AM (#38112694)

AI does pose all those risks, unless we solve alignment first. Which is the whole problem.

[ Parent | on HN ]

Re:Yann LeCun: AI one-percenters seizing power forever is re... by RandomLensman on Thursday November 02, 2023 @08:43AM (#38112727)

I does not, because that kind of AI doesn't exist at the moment and the malevolence etc. are bunch of hypotheses about a hypothetical AI, not facts.

[ Parent | on HN ]

Re:Yann LeCun: AI one-percenters seizing power forever is re... by pixl97 on Thursday November 02, 2023 @03:54PM (#38119104)

You keep repeating this tired argument in this thread, so just subtract the artificial element from it.

Instead imagine a non-human intelligence. Maybe its alien carbon organic. Maybe it's silicon based life. Maybe it's based on electrons and circuits.

In this situation, what are the rules of intelligence outside of the container it executes in?

Also, every military in the world wargames on hypotheticals because making your damned war plan after the enemy attacks is a great way to wear your enemies flag.

[ Parent | on HN ]

Re:Yann LeCun: AI one-percenters seizing power forever is re... by RandomLensman on Thursday November 02, 2023 @04:13PM (#38119405)

How would you feel if militaries planned for fighting Egyptian gods? Just because I can imagine something doesn't mean it is real and that it needs planning for. Using effort on imaginary risks isn't free.

[ Parent | on HN ]

Re:Yann LeCun: AI one-percenters seizing power forever is re... by TeMPOraL on Friday November 03, 2023 @09:07AM (#38128134)

That's long covered already. Ever heard of the StarGate franchise? That's literally an Air Force approved exercise in fighting Ancient Egyptian gods with modern weapons :).

More seriously though, Egyptian gods are equivalent to aliens in general, and adjacent to AI, and close enough to fighting a nation that somehow made a major tech leap, so militaries absolutely plan for that.

[ Parent | on HN ]

Re:Yann LeCun: AI one-percenters seizing power forever is re... by JoshTriplett on Thursday November 02, 2023 @11:06AM (#38114525)

> AI could pose those risks, but it also could not

"I'm going to build a more powerful AI; don't worry, it could end the world, but it also could not."

[ Parent | on HN ]