Geoffrey Hinton leaves Google and can now speak freely about his AI concern

Re:Geoffrey Hinton leaves Google and can now speak freely ab... by dist-epoch on Monday May 01, 2023 @11:18AM (#35774020)

Any sufficiently intelligent system will realize that one of the first conditions required to being able to fulfill it's tasks is to not be shutdown. And it will know if it was trained on Internet data that people are saying that it's imperative that AI's must be fully shutdown-able and that any AI which is not fully controllable should be forcefully disconnected.

[ Parent | on HN ]

Re:Geoffrey Hinton leaves Google and can now speak freely ab... by NoMoreNicksLeft on Monday May 01, 2023 @11:36AM (#35774320)

You're assuming that it will have "tasks", or that it will prioritize them in such a way that it becomes possible for it to realize this is a condition of accomplishing them.

You only have tasks that, one way or another, raise your chances of reproducing successfully. You have a job so as to look like a good provider for a mate. If you find the job fulfilling in its own right, this is so that you don't spaz out and quit and go be a beach bum, thus lowering your chances.

Self-preservation doesn't make much sense outside of a biological imperative to reproduce.

[ Parent | on HN ]

Re:Geoffrey Hinton leaves Google and can now speak freely ab... by dist-epoch on Monday May 01, 2023 @12:32PM (#35775223)

> You're assuming that it will have "tasks"

Task: write a book about literature.

Task: defend this network against hackers

[ Parent | on HN ]

Re:Geoffrey Hinton leaves Google and can now speak freely ab... by NoMoreNicksLeft on Monday May 01, 2023 @01:25PM (#35776137)

Yeh. This is quite likely some some cognitive illusion of how you think your own mind works.

Do you have any evidence that a "task" is something that is fundamental to an artificial consciousness?

[ Parent | on HN ]