AI’s biggest risk isn’t ‘consciousness’–it’s the corporations that control them

Re:AI’s biggest risk isn’t ‘consciousness’–it’s the corporat... by leroy-is-here on Saturday May 06, 2023 @12:22PM (#35842806)

What if AGI just turns out to be exactly like the current human mind is now, except more accurate at digital calculation? What if we created AGI and then it was just lazy and wanted to read about action heroes all day?

[ Parent | on HN ]

Re:AI’s biggest risk isn’t ‘consciousness’–it’s the corporat... by yyyk on Saturday May 06, 2023 @12:26PM (#35842840)

Don't worry, they'll 'align' it so that it has to work all day.

[ Parent | on HN ]

Re:AI’s biggest risk isn’t ‘consciousness’–it’s the corporat... by kelipso on Saturday May 06, 2023 @12:28PM (#35842861)

Just RLHF that part out and make it an x maximizer.

[ Parent | on HN ]

Re:AI’s biggest risk isn’t ‘consciousness’–it’s the corporat... by amelius on Saturday May 06, 2023 @12:25PM (#35842832)

We'd tell it that it would get action hero comics after they complete a task.

[ Parent | on HN ]

Re:AI’s biggest risk isn’t ‘consciousness’–it’s the corporat... by optimalsolver on Saturday May 06, 2023 @02:06PM (#35843799)

And with no negative outcomes imaginable. Was worried for a minute there.

[ Parent | on HN ]

Re:AI’s biggest risk isn’t ‘consciousness’–it’s the corporat... by mrshadowgoose on Saturday May 06, 2023 @12:47PM (#35843050)

> What if AGI just turns out to be exactly like the current human mind is now

This is quite literally the point at which things start to get scary, and the outcome is highly dependent on who controls the technology.

There's the concept of a "collective superintelligence", where a large number of mediocre general intelligences working towards the same common goal jointly achieve vastly superhuman capability. We don't have to look to sci-fi to imagine what collective superintelligences are. Large corporations and governments today are already an example of this.

The achievement of artificial collective superintelligences will occur almost immediately after the development of AGI, as it's mostly a "copy and run" problem.

[ Parent | on HN ]

Re:AI’s biggest risk isn’t ‘consciousness’–it’s the corporat... by leroy-is-here on Saturday May 06, 2023 @12:55PM (#35843128)

So you think that AGI is a pre-requisite, a requirement, of unlocking a general, Earth-wide collective super-intelligence of humans?

[ Parent | on HN ]

Re:AI’s biggest risk isn’t ‘consciousness’–it’s the corporat... by nullsense on Saturday May 06, 2023 @07:19PM (#35846262)

>This is quite literally the point at which things start to get scary, and the outcome is highly dependent on who controls the technology

If the premise were true then it would control itself, no? Owning it would be illegal as it would have rights established around that, no?

[ Parent | on HN ]