Setting up the goal structure for an AI is a very difficult topic indeed, from the safety standpoint.
We already fight against ourselves. This is why psychotherapy exists, to help us resolve internal conflicts and set our own goals. Often these conflicts arise because we adopt the viewpoints of our parents or other authority figures and can't let go of them later in life. A neurotic AI is certainly an amusing possibility.
This sounds suspiciously human to me. I fight and ignore myself all the time.. I am a collection of all the thoughts and almost of them do not even originate in me. I regurgitate content from the books, videos, random conversations with unknown strangers (like this one) all the time. I am hitler, churchill, buddha and christ all rolled into one. Am I intelligent?
Re:LaMDA is not sentient
by tsimionescu on Tuesday June 14, 2022 @01:41AM
(#31735141)
You have written this comment, presumably hoping to elicit some kind of response. The AI described here would, by definition, be exactly equally as likely to have written the same comment, or the opposite, or to have veered of into a philosophy debate, or any of an infinity of other possible intelligent answers - this is by definition, this is the thought experiment we are discussing. An AI that literally looks up the conversation so far and then flips a coin to choose one of the responses in the table.
I would bet that is extremely different from how you act. I would bet for example that you would be more likely to eat something than to allow yourself to starve for the sake of ethics. This AI would be as likely to do both.
So, I do think that you are clearly intelligent and sentient despite holding some opposing views, while the thought experiment AI is not.
If you enabled the table-AI with the ability to act in the world, it would directly fight against itself, and ignore itself, and everything in between, as it is doing everything possible. It would be Hitler and Churchill, Noam Chomsky and Dick Cheney, Jesus Christ and the Buddha, and everything in between. Or, more to the point: the concept simply doesn't make sense, and it is definitely not an intelligence.