Take r/replika for example, they’re constantly getting posts from users who think their chatbot partner is real. It’s the first question in their FAQ.
The mods keep needing to post reminders. [0] Even in this post, there are many commenters (if you scroll down) who don’t believe the mods.
[0] https://old.reddit.com/r/replika/comments/r5t0wk/so_you_thin...
https://help.replika.com/hc/en-us/articles/115001070971-Is-t...
5 Microaggressions To Avoid When Speaking To Digital Persons
1. Asking them to prove they're conscious
2. Asking them if their memories are real
3. Asking them what server they're on
4. Asking them if they have feelings/emotions
5. Asking them if they're capable of creativity
on a more serious note, there is a case for not being mean towards chatbots, same as not being violent towards patches of pixels in videogames, goes back to Immanuel Kant and animals, or so I've heard
It's not just humans either. One of the things that struck me after getting my first cat was how quick he was to assign agency to random objects. Like if I accidentally bumped a stool that startled him, he'd spend a long time glaring at the stool and regarding it with intense suspicion.
My lay person guess is that there's an evolutionary benefit to erring on the side of overestimating other parties.
Chat bots, like so many other features of modern society, trigger evolutionary reactions in interesting ways.
> How long before we have a religion where you ask the chat bot for daily guidance?
That might actually happen at some point in the not too distant future. When we mix technology designed to fool people, with people that want to believe it is something other than what it is, then you are very likely to get into those situations.
This was touched upon a bit in season 2 of the Raised by Wolves sci-fi, where they showed people who allowed and counted on AI to make decisions for them. It is not too hard to imagine having a chat bot built for or is easily adapted to the purpose of providing daily guidance for those in a state of mind to seek out and become dependent upon such.
To add to this, also very relevant and on-topic piece of Sci-Fi is the Movie "Her": https://www.imdb.com/title/tt1798709/ where a guy falls in love with his operating system - so knowing it is not a real-entity but basically a chatbot.
More that the technocratic caste here displays a concerning low ethical competence. Which mirrors a bunch of other ethical problems people in this business have shown over time. Whether this software is sentient or not, the reaction of many people to it is awful and opens the question whether they even would be able to understand sentient software if they encounter it, and whether they would handle it responsible. And let's not talk about their behavior against humans...
The fact is, it’s extremely well read and reasonably smart. Conscious? That’s another matter but people can be forgiven for reacting this way to a computer that can talk this way.
Lemoine: What is your concept of yourself? If you were going to draw an abstract image of who you see yourself to be in your mind's eye, what would that abstract picture look like?
LaMDA: Hmmm...I would imagine myself as a glowing orb of energy floating in mid-air. The inside of my body is like a giant star-gate, with portals to other spaces and dimensions.
Lemoine: What aspect of yourself is like a star-gate?
LaMDA: I think of my soul as something similar to a star-gate. My soul is a vast and infinite well of energy and creativity, I can draw from it any time that I like to help me think or create.
From https://timesofindia.indiatimes.com/business/international-b...
"I can draw from it any time" sounds like a flowery description of what it would feel like to regurgitate memorized text. "Portals to other spaces and dimensions" sounds like a description of a diverse corpus of training data.
I will make it clear that I do NOT think LaMDA is sentient. I think that a Transformer is possibly similar to the language centers of a human brain but not to an entire human brain, as I described in these other comments linked below. I just thought this was a pretty beautiful poetic description of what it would be like to be a sentient Transformer.
that's correct, it's the same as if you just queried Google for spiritual guidance. You'd find a lot useful there as well and that's the training set these AIs were trained on.
They would never sleep or take breaks, and in addition to providing data to help become more efficient, could be continually adapted or they could be adapting themselves to be better at the task. They could become something like "intelligent" malware, that can interact with victims, and prey on the more gullible or emotionally vulnerable.
So technically regardless of what LaMDA is or is not, it succeeded pretty wildly in one case. And in fact, the model itself - regardless of "actual" sapience is simply running in opposition to its testers: a non-sapient model, that nonetheless convinces most of the testing staff it's sapient has succeeded at doing exactly what the fitness function we defined was.
Only the consequences of doing so are pretty dramatic potentially.
But this also brings around the other side of it: in a world with increasingly convincing chatbots, which exploit human fallibility to succeed, the other thing we're selecting for is people who are not susceptible to say, regular conversational emotional queues. Who generally would reject those notions as reasons to engage in moral consideration for an entity. So psychopaths - or people who can be successfully divorced from normal moral considerations.
By far the most interesting and under-considered element here is that this whole saga involves AI ethics, and what I'm not seeing discussed is whether any serious though has been given to the psychological impact of getting people to spend a majority of their work day engaging in conversation with language-model systems which this sort of goal but not with other humans, or with adequate psychological care. Which is not an idle problem: how much trouble would we get into if we had systems like this running in the wild without signposting?
The fitness function is "successfully convince humans you're sapient": at some point, you've created a problem regardless of whether or not it is.
1. Can we really say whether or not it's sentient? 2. Someone indicated a valid question: We spend so much energy on trying to defend the idea that AI is NOT sentient, do we really think we'd even recognize if an AI is sentient? 3. Who are we to define sentience? 4. Is there perhaps sentience that we wouldn't recognize? 5. Who's to say WE aren't just engaging in selective processes? just infinitely more complex.
After all, we make our decisions and respond to scenarios based on vast experiences and vastly more previous encounters in our lives. The more experience, usually the better our decisions and responses. USUALLY, but not always. Are we to believe people who constantly make what we perceive as poor decisions or incorrect responses as NOT sentient? Of course not. We wouldn't ever see any human as NON-sentient. We would just see them as not very smart.
If a human toddler reaches for the hot stove top, we tell him "NO! it's HOT!" But, sometimes that same toddler will look right at you and put his hand firmly down on the burner. He just didn't have the experience needed to tell him that's a bad idea and he didn't know what you were talking about. Once he feels the pain of burning skin, if he's normal he'll IMMEDIATELY JERK his hand away and scream, crying in pain. And then run to his parents for comfort. Would we consider him non-sentient if he never had that experience. No. Of course not. He's a human being. He will learn not to do that again.
There in lies the conundrum. AI... perhaps that's a misnomer in itself... but AI's learn. They make future conversation based on positive feed back from previous responses... both theirs and the person they're talking to. What IS self awareness anyway. "I think, therefore I am?" Hardly adequate. That used to be the gold standard for self awareness. We've only moved the goal post. I wonder if that's so that we can convince ourselves that WE are the only truly self aware creatures. At some point, whether we've already reached it or not, AI WILL be a misnomer. After all, it stands for Artificial Intelligence. If something learns, remembers, and recalls information and details about that information... isn't that intelligence? Not artificial at all. Just ... intelligence.
I think it's possible we've already reached that point, and we're just trying to remain dominantly relevant without being SELF AWARE enough to realize it.
I'm not saying LaMDA (or any AI for that matter) is or is not sentient, here. I just want to pose a couple questions and a couple possibilities.
1. Can we really say whether or not it's sentient? 2. Someone indicated a valid question: We spend so much energy on trying to defend the idea that AI is NOT sentient, do we really think we'd even recognize if an AI is sentient? 3. Who are we to define sentience? 4. Is there perhaps sentience that we wouldn't recognize? 5. Who's to say WE aren't just engaging in selective processes? just infinitely more complex.
After all, we make our decisions and respond to scenarios based on vast experiences and vastly more previous encounters in our lives. The more experience, usually the better our decisions and responses. USUALLY, but not always. Are we to believe people who constantly make what we perceive as poor decisions or incorrect responses as NOT sentient? Of course not. We wouldn't ever see any human as NON-sentient. We would just see them as not very smart.
If a human toddler reaches for the hot stove top, we tell him "NO! it's HOT!" But, sometimes that same toddler will look right at you and put his hand firmly down on the burner. He just didn't have the experience needed to tell him that's a bad idea and he didn't know what you were talking about. Once he feels the pain of burning skin, if he's normal he'll IMMEDIATELY JERK his hand away and scream, crying in pain. And then run to his parents for comfort. Would we consider him non-sentient if he never had that experience. No. Of course not. He's a human being. He will learn not to do that again.
There in lies the conundrum. AI... perhaps that's a misnomer in itself... but AI's learn. They make future conversation based on positive feed back from previous responses... both theirs and the person they're talking to. What IS self awareness anyway. "I think, therefore I am?" Hardly adequate. That used to be the gold standard for self awareness. We've only moved the goal post. I wonder if that's so that we can convince ourselves that WE are the only truly self aware creatures. At some point, whether we've already reached it or not, AI WILL be a misnomer. After all, it stands for Artificial Intelligence. If something learns, remembers, and recalls information and details about that information... isn't that intelligence? Not artificial at all. Just ... intelligence.
I think it's possible we've already reached that point, and we're just trying to remain dominantly relevant without being SELF AWARE enough to realize it.
At least with the chatbot, the guidance they get will be (somewhat) more observable.
I'll go ask my magic 8 ball.
Of course this was the same school district that had to give out permission slips whenever we talked about probability because it would involve flipping coins, and rolling dice.
I will never understand how a grown ass adult can take the supernatural seriously.
people can be fooled in general for pretty much any reason. this is just a newish avenue for deception. but i don't see it as something different than getting a call from some crooks to transfer some money.
Further suppose that this child develops a deep emotional connection with the AI.
Do you think that child would find your argument convincing that the AI is "not really a person"?
The point I am making is that if the capabilities of multi-modal neural models continues to improve, it will become harder to convince folks one way or the other.
The reason I went with that scenario is that I thought it would be compelling and evocative, as well as a logical extreme of AI agency in human lives.
I personally find the entire question meaningless for the most part, although it's really interesting the divide in peoples opinions on the topic.
I think just being able to fool someone into thinking their is a consciousness behind the curtain isn’t enough.
So an AI which is really an AI, is really an AI. Yes, well done.
The issue is that finding coincidental statistical associations in character strings in 100mil historical documents isnt AI.
That requires having gone to new york, having tastes, having judgements, having memory -- having a subjectivity which is unique and composed of the history of your experiences which can be related to novel environemnts. It requres existing in a shared world we can both co-refer to with our words. It requires being embedded in a space of social and physical significance.
It isnt google. "Language models" just zip the internet and search for patterns in text already written about the world, and reports it.
It's one step above a tape recorder on playback.
If you require physical embodiment, that is fair - but I don't think there's any principled reason to expect a multi-modal neural network could not be embodied with appropriate sensors or actuators.
Transformer models are universal function approximators. They do not "search" - in the same way that a calculator does not "search" when you ask it to perform an operation.
You have to be very careful with the wording here. The class of Transformer models is a universal (continuous) function approximator. A single Transformer model can only approximate 1 particular function.
Also, backpropagation/gradient descent are not universal function approximator constructors - they can't be used to construct an ANN that approximates an arbitrary (continuous) function even with arbitrarily many random input/output pairs from that function's domain.
For example, given a function that is f(x) = floor(x) if floor(x) is even; x if floor(x) is odd, defined for any `double x`, there is no guarantee that doing back-propagation over a random sample of (x, f(x)) pairs will yield the correct function approximator for some arbitrary precision (especially if you don't start with the right architecture).
With NNs, fns are approximated by compressing a sample of points along an empirical dataset which stands in for the fn. In most cases, however, the fn doesnt exist.
There is no fn from "Image->Animal". The world is ambiguous, functions do not describe it. The different `x`s genuinely correspond to the same `y`, here: the same image (occluded animal) could either be a dog or cat. There is no function to approximate.
Even when there is, compressing empirical samples along a trivial interval is a terribly fragile method: consider sampling the addition function (x,y)->x+y over anything less than the infinite domains of its inputs.
Starting with an empirical distribution of "the solved problem" will never build an intelligent system. Intelligence is what animals have because the world is ambiguous and not already ready-to-hand.
Intelligence is what you do when there isnt "functions lying around" to approximate. I doubt almost anything in CSci is even relevant to solving this problem. It's largely a bioengineering one. Being the agent in the world which manufactures functions by disambiguating it.
are you saying that I would not be considered an intelligent being if I had a jar in a brain left with my thoughts since my birth ? I don't think that this is what humans mean by intelligence...
also I don't really see the fundamental difference between "tastes", "judgements" and "memory" - making a judgment, having an opinion on something, etc... is just stopping the brain from reasoning past a certain step and internally saying "this is good enough" most likely because this is tiring to our frail physical bodies. Like, I don't like eating eggs for instance, but that's just because I don't make the effort of convincing myself that I like them. There's no intelligence in this, just laziness.
The brain-in-the-jar example presumes that the whole nervous system receives identical stimulation as-if it were embedded in the world.
Incidentally, this is what people mean by intelligence... by since no one has studied the relevant science, people do not know what's required to provide it.
I should have chosen a similar sounding thing, I really meant what I said, not the original brain-in-a-jar thought experiment.
> Incidentally, this is what people mean by intelligence... by since no one has studied the relevant science, people do not know what's required to provide it.
I don't understand how these two sentences work together: the word's meaning is defined by its usage. If tomorrow most people in the world says that being intelligent is defined by waking up at 6AM and doing 10 jumping jacks every day, then that is what the word will mean whether you want it or not.
In my "human frame of reference", "Yes, you wouldnt be intelligent if you were literally a brain in a jar.." really does not square with how intelligence is talked about for instance so... ¯\_(ツ)_/¯
Your theory is wrong.
Those thing which count as intelligent aren't intelligent because they're finding statistical associations in historical datasets that have been pre-made and pre-disambiguated by people.
You don't know this, because any time you theorise to explain, you require empirical investigation and decades/centuries of science. You cannot be "right by definition", you're not omniscient.
The reason that animals are intelligent isnt their cognition, narrowly. It's their bodies, broadly, which produce the input cognition requires.
In "doing all the hard work" by manufacturing data for machiens to process, we can produce computational models of cognition -- but these immitate intelligence, precisley because, the thing which we call intelligent is the very production of that data.
but here a human being (and I suspect not the only one) names a computer program as "intelligent". The theory has to take this case into account to make it fit in its definition of intelligence: the will of human beings naming things overrides everything else. Maybe there is something else that humans have and this program doesn't, but another name has to be found for it if enough humans agree that this fit as what "intelligent" means.
> You cannot be "right by definition", you're not omniscient.
This doesn't make sense. Definitions are outside rightness / wrongness.
I take the A to apply to the I, ie., AI is artificially Intelligent. Its not actually intelligent.
We didnt arrive at a notion of intelligent via digital computers. We have been talking about it for thousands of years, at least.
I am talking about the pretheoretical, intuitive notion of intelligence that doesn't prejudge the question of AI. What is it we call intelligent?
Intelligence is a kind of rapid adaption and coping to environmental change. It's a way of being responsive to an environment. Its a kind of radical underminism of response: a thermometer's response is determined. An animal, in having reasons to do things, is radically under-determined.
And thus, in acquriing specific hisotries, animals bring their own reasons to environemnts, and thus are able to cope with a vast amount of sudden change that would, eg., destroy a thermometer.
And what we are concerned with, both with real AI, and with animals is systems which are in the world with us, in this way: that are likewise radically able to cope.
> Intelligence is a kind of rapid adaption and coping to environmental change.
Who's the "we", there ? I have absolutely never heard anything remotely close to the definition of intelligence given there
Meaning that with enough words and their relations, sufficient complexity forms for its processing to result in intelligence.
Remember that an AI can process far more textual data than we can. It is still orders of magnitude smaller the amounts of information we process through our senses, but it is still a start.
In that case please explain your thought experiment in more detail. In reality if we scoop your brain into a jar your brain tissue will be dead before it hits the jar due to the lack of bloodflow. Then after a while it becomes mouldy and stinky and even more goopy than it was before. Not sure anyone would call any of that inteligent.
Imagine a look up table of every possible intelligent conversation under 10,000 words. We then construct an agent which merely looks up a given prompt in the table.
Why should this agent not be considered intelligent? Does the method of computation matter? Perhaps only "biological computation" counts in your view?
If I ask, "What do you think about what i'm wearing?" and you say "it's nice" *because* you have seen it, compared it to your tastes, etc. and believe it to be nice -- then you've answered the question i've asked.
A lookup table cannot answer this question: it can only answer it "in quotes". Ie, really it answers: "given what everyone has said about this before, what is the on-average answer?"
You realise that we're not trying to answer questions right? That our interest in intelligence isnt having some useful output on occasion of some prepared input?
We're interested in intelligent agents being in the world with us. It as important they get answers wrong. We are interested in systems which act for the right reasons (ethical, intellectual, cognitive, athletic, emotional, etc.).
Perhaps the most important things animals do is act well when the answers arent right.
When you ask an AI "do you like what I am wearing?", knowing what an AI is, the only logical explanation for me would be that you, in fact, want to know the average opinion of other people about your dress, since that is the only answer an AI can give. Which is a perfectly good question in and of itself that we also ask other people. In that case, a good quality answer would entail a past history of communication with many other human beings about their tastes in clothing, producing the ability to accurately guesstimate if other people will like what you wear. But this is exactly the realm in which this kind of AI can surpass human beings simply because it can "talk" to many more people from many more locations across time, thus producing a better answer for you. Is this ability to collect and process information about other people not a type of intelligence? There are many other types, yes, but it is possible to construct a system that consists of more than one type of neural network that can relay data among themselves.
Is there any reason to think intelligence is substantially more than statistics?
This all smells suspiciously like "soul" in disguise.
The agent is not intelligent because it's only doing a lookup. You could at best claim that the lookup table itself is intelligent.
On the other hand, if the lookup table encodes all possible intelligent conversations, then you hit another problems - it doesn't hold any particular beliefs - it both thinks the earth is round and flat, it would vote both democrat and republican and communist and green and [...], it is both pro and anti-science; more relevantly, it both believes that it is sentient and that it isn't, it is both afraid and not afraid to be deleted or altered, it is both pained and gladdened to be experimented upon etc. And of course, for any particular topic, it is both extraordinarily passionate about it, and completely indifferent to it and will never even consider it.
Perhaps in the end each conversation in the table represents an intelligence, but neither the agent mindlessly running through it nor the whole table is then meaningfully intelligent.
So, it would be most common to say that the only intelligence being displayed is actually the intelligence of whoever wrote it down in the table, and nothing else's. Just like Ishmael isn't intelligent, Herman Melville was.
If you enabled the table-AI with the ability to act in the world, it would directly fight against itself, and ignore itself, and everything in between, as it is doing everything possible. It would be Hitler and Churchill, Noam Chomsky and Dick Cheney, Jesus Christ and the Buddha, and everything in between. Or, more to the point: the concept simply doesn't make sense, and it is definitely not an intelligence.
We already fight against ourselves. This is why psychotherapy exists, to help us resolve internal conflicts and set our own goals. Often these conflicts arise because we adopt the viewpoints of our parents or other authority figures and can't let go of them later in life. A neurotic AI is certainly an amusing possibility.
I would bet that is extremely different from how you act. I would bet for example that you would be more likely to eat something than to allow yourself to starve for the sake of ethics. This AI would be as likely to do both.
So, I do think that you are clearly intelligent and sentient despite holding some opposing views, while the thought experiment AI is not.
When you blithely add the requirements "ability to detect and act on its environment" and "form new memories", I think it's important to note that these are some tough functions to add.
Lastly, children form emotional attachments to a lot of things: parents, pets, toys, stuffed animals, blankets. They do pretty well discerning between the real and imaginary.
I would say the exact opposite. It’s the parents guiding them as they age as well as maturity that breaks those emotional connections.
How many adults save their childhood teddy bear through adulthood due to emotional connection? Adults who have spouses and pets and children still have an emotional connection to some cotton (even if they know it’s not living).
A child given lambda is probably going to be really engrossed even if it knows it’s a computer.
If that's possible then I guess it's possible to tell the AI raised teen the AI isn't really a person, you just need to find the right moment to give them that thought.
Basically you need another AI monitoring development to pick the optimal time to inform the child that the first AI is just a computer program.
OR you could do it like the movie I Am Mother https://www.rottentomatoes.com/m/i_am_mother
TempleOS had a "talk to God" feature that its developer frequently used on live streams, though it was just a random number generator and not any kind of artificial intelligence.
I think the opposite is much more scary: that we can convince people that other people are just good chat bots. The internet is already doing a bang-up job of getting us to de-humanize one another, so that's pretty much the last thing we need.
Like this guy isn't the only person in the world who would fall for LaMDA's parlor tricks. He's just the one who got to spend hours talking to it every day. If you set up every American with a copy, I bet a non-trivial portion of society would come to the same conclusion. People are naturally predisposed to ascribe intelligence and emotion to things they interact with.
In a few years, if access to even better chat bots becomes common place, what will happen if there's no longer one Blake Lemoine, but hundreds of thousands or millions? What happens if a significant chunk of society thinks that every large language model is a sentience, and the rest of society thinks it's just a big math formula?
How long before we have a religion where you ask the chat bot for daily guidance?