This argument is very well expressed in Professor Jefferson's Lister Oration for 1949, from which I quote. “Not until a machine can write a sonnet or compose a concerto because of thoughts and emotions felt, and not by the chance fall of symbols, could we agree that machine equals brain—that is, not only write it but know that it had written it. No mechanism could feel (and not merely artificially signal, an easy contrivance) pleasure at its successes, grief when its valves fuse, be warmed by flattery, be made miserable by its mistakes, be charmed by sex, be angry or depressed when it cannot get what it wants.”
This argument appears to be a denial of the validity of our test. According to the most extreme form of this view the only way by which one could be sure that a machine thinks is to be the machine and to feel oneself thinking. One could then describe these feelings to the world, but of course no one would be justified in taking any notice. Likewise according to this view the only way to know that a man thinks is to be that particular man. It is in fact the solipsist point of view. It may be the most logical view to hold but it makes communication of ideas difficult. A is liable to believe ‘A thinks but B does not’ whilst B believes ‘B thinks but A does not’. Instead of arguing continually over this point it is usual to have the polite convention that everyone thinks.
--
I.—COMPUTING MACHINERY AND INTELLIGENCE
A. M. TURING
Mind, Volume LIX, Issue 236, October 1950, Pages 433–460, https://doi.org/10.1093/mind/LIX.236.433
But, although it will give the impression (illusion) of feeling, it will still be running its code. Humans will have coded a fantastic illusionist, with no more emotional ability than any other tool, eg a hammer.
> According to the most extreme form of this view the only way by which one could be sure that a machine thinks is to be the machine and to feel oneself thinking.
This is true - one can only verify subjectivity in oneself. One might assume another living being does feel - but, we could be wrong - eg psychopathy can mean that others are unaware of a psychopath's "feelings" or lack of.
It does seem to me, that if we were able to code an ai that gives the impression of feelings, composes concertos apparently independently, etc, that ai would have to be a sort of psychopath.
Without getting too lost in spiritual BS, I think we are more than mere matter - the value in our experiences come from our emotions and feelings - not mere inputs that we label as 'emotions' and 'feelings' as would be the case for an ai. But emotions etc are subjective states, not objectively verifiable (even if we can see something correlating on a chart).
Put simply, ai can never have a 'soul' even if it presents a wonderful appearance of kindliness, emotionality or whatever. Perhaps there will be no test in the world that will be able to find this out. But it still won't have feelings, it can only ever be a automaton.
</sarcasm> Because humans have emotions, but not just what we 'label as emotions' but you know, 'real' emotions, not like those AI emotions.
So basically, you are arguing for a non-logic assumption that humans have souls, Machines can't, and we should just take that as gospel and move on.
I do think the materialistic idea that we are a sort of computer, with hardware (the body) and software (the mind) is a brilliant metaphor... but like any metaphor it is only so useful. Many people nowadays believe this metaphor to be literal. However, it is too mechanistic and does cannot account for subjective intangibles which is where all the value of life is, eg boredom, excitement, joy. Ie life is occurring in the experiences of the 'computer operator' in the metaphor.
Honestly the more I see from LLMs the more it makes me think that we are much the same. Imagine a network of many different LLMs each given different capabilities and prompts, each able to communicate with others. Now imagine splitting this network in half, wouldn't the resulting adjustment look similar to a split brain patient in humans? Are "you" possibly just the LLM that has been given control over the speech and other intentional body actions?
I don't see how that can be. You have no experience of anyone else subjectively. For all you know, you could be a 'brain in a jar' with inputs coming in via wires, other people could be part of the illusion. The only thing you can say you know is your own present experience - it is infinitely special. Sure, when you consider yourself objectively, you appear to be like one of so many people. But, there's no getting away from the fact your own experience is infinitely special to you. And it has meaning/value to you because of emotions. Animals seem to, but these are not at the same level. Machines give no indication of emotions. AIs appear to have emotions, but this is a simulation/illusion - like those medieval wooden toys, but better.
> I can understand people entirely different to myself so I can empathize and work with them.
This is a form of projection, imo. You have no idea about what is going on inside others. You only have appearance to guide you.
> Honestly the more I see from LLMs the more it makes me think that we are much the same.
If you take a purely objective, materialistic viewpoint, why not consider it the other way - that we ourselves are a sort of AI, our hardware being wetware/bodies - just mechanistic. Do you think you are an AI? (As was illustrated in Westworld?)
Is it "projection" to think we have insight into other minds? Sure, but if you do that projection by default then you won't think that you're special — to project like that is to be absent that thought.
> And it has meaning/value to you because of emotions. Animals seem to, but these are not at the same level. Machines give no indication of emotions. AIs appear to have emotions, but this is a simulation/illusion - like those medieval wooden toys, but better.
Likewise for this: there are many cases where humans project meaning/value onto even inanimate things, or even onto what we imagine other people might be doing — this is why "blasphemy" is a concept and not just a string of letters/phonemes, and also why people with real and violent actions to propaganda that demonises some minority or individual.
Do any AI have emotions[0], or are LLMs merely good at pretending? Both can be true at the same time (LLMs being only one of many kinds of AI), or exclusively one, or neither.
[0] regardless of if this is meant as "the qualia of emotions" or "something which has a functional influence on the network's output that is similar to the influence on human brains of hormones associated with emotions"
The fact that my experience is the only one I can experience, makes it special to me; at the same time, by default, unless and until given reason to the contrary, I project onto everyone else the same mind that I myself have.
I don't currently share ninjanomnom's opinion, but I used to: they wrote "I've never thought I was special" — as a child neither did I, but over the years I have learned this is not correct, and that I'm weird in a lot of ways. I don't experience so much disgust as others seem to, with the exception of violent horror where my disgust reaction is vastly stronger than that of society at large. I do have an extreme disinterest in spending money that means I can't even imagine regularly spending as much as €750/month combined on all the things that aren't rent/mortgage repayments. Conservatism was an alien concept until I learned about Chesterton's Fence. Back in the late 90s, I was one of about 4 kids in a school of 1000 who preferred to do maths homework than to have the afternoon off to watch the World Cup (and at that point I didn't even realise that made me weird, I thought everyone else was weird for watching it).
As a kid, I projected my thought process onto other humans, and (thanks to a teenage fling with Wicca) natural phenomena. Yes, this was an error on my part; my mum remained a believer in the supernatural for her whole life, told me she was disappointed when my (older) brother stopped believing, and I overheard her saying much the same to my partner about me when she realised I'd stopped believing.
It may well also be an error to project any kind of mind-model onto LLMs. We don't know for sure yet, because we don't know what it would take for an information processor to have qualia. (Why do I have qualia? My brain is a bag of cells sending electrochemical signals to each other). That said, I'd say there's value to interacting with them as if it were truly "like us": as they are trained on human interactions, I believe you get the most out of them by talking to them in the same way you'd talk to a human, regardless of what is or isn't going on inside.
But even though I can reason that I'm special (or at least that I'm weird), if I'm not actively thinking about it, I still default to projecting onto other humans and certain animals.
The problem I see is we keep looking for supersets of all these features added together, and as the article points out, something that humans have....
>This rationale is particularly powerful if human experience is limited to a small, and perhaps idiosyncratic, region in the space of possible states of consciousness, as may be the case.
There will be a large part of humanity that will want consciousness/sentience as something that humans have and other things don't (you already see this often with the 'has a soul' argument). This will set us up to have a large blind in to machine systems behavior in self organizing systems, and is a shared concern among those that see AI as a potential existential risk.
It is about how to test consciousness in a wide variety of things. We have no tests.
People may think their dog is conscious, but we can't test that. We can't even test if other people are conscious.
What about invertebrates? Bacteria? Rocks, atoms, AI, your laptop etc? While somebody might say "yes, no, definetly not, yes, maybe" ... still, no tests.
And consciousness in this particular proposal deals with whether or not it "‘feels like’ something to be the target system".
If that is the case why hasn't Kurzweil already won the bet? https://longbets.org/1/
The limitations of the Turing test have been discussed for much longer than that. Ironically its dependence on human judgement is arguably a weak point.
What other thing in reality has better judgment? Nothing.
I strongly dispute this. Try "talking" to an LLM over time. It has no memory, no agency, no emotions, no desires, no sense of self.
I think cats, dogs and certainly primates are far more conscious than these stochastic parrots. It do agree it's frightening how many people are fooled by a fancy autocomplete.
It does have permanent memory, that's what training creates. It doesn't have agency. Whether it has desires, pain or sense of self is completely unknown, unless of course you have some mechanistic model of these phenomena such that we can see its presence in the human brain and see that LLMs do not have a comparable process.
Of course you don't have such a model because it doesn't exist at this time. The problem is not that people have been fooled by stochastic parrots, it's that you've fooled yourself into thinking we understand more about the human mind than we actually do, and also possibly that humans are far more complex and special than might actually be the case, eg. that we are not basically stochastic parrots ourselves.
I don't necessarily think humans are so special (cf. my mention of other mammals) but biology is extraordinarily messy and complex.
Computer people tend to handwave the details with crude, reductive analogies (DNA is like source code! Neurons are like circuits!) but the reality is so much more overwhelming. Every single thing affects every other thing. Everything is probabilistic. There are multiple interacting chemical and electrical communication pathways. Neuroanatomy varies from individual to individual and in the same individual over time. The brain can radically adapt in response to trauma in a way that no computer model does.
Even at the level of individual neurons[0] (of which there are 2.25 billion in a dog's brain) there's an enormous amount of "processing" happening. This is not like a computer processing - but physical, biological processes occurring that integrate informational content.
I get it, everyone is very impressed with LLMs and I'm open to the possibility that some future model might achieve consciousness (to say nothing of sentience) but computer people in particular are way, way too credulous of this stuff and ignorant of what the messy, malfunctioning wetware in their head is actually doing.
You don't know that LLMs lack such a rich and complex inner life while they're running.
> but computer people in particular are way, way too credulous of this stuff and ignorant of what the messy, malfunctioning wetware in their head is actually doing.
Everything you mentioned is completely irrelevant to the argument, which is based on well known physical principles. Due to the Bekenstein Bound, I already know that you and your "rich and complex inner life" can be fully captured by a finite state automaton. Your protests that you are not a stochastic parrot based on hand-waving about your subjective experience, or vague assessments of how much processing is happening in a messy biological brain that has plenty of redundancies are simply not compelling.
The fact is, we lack mechanistic models for any folk psychology concepts like "pain", "desires", "agency" and "sense of self", and so any claims that LLMs lack such things is conjecture at best. What I do know is that there's an impressively long history of wrong people who thought humans were special.
Literally the third time you've beaten this straw man. Keep going, though. All the other species of monkeys and I are enjoying it.
> so any claims that LLMs lack such things is conjecture at best
Holy shifting the burden of proof, Batman! It's incumbent on you to show that your fancy pattern-matching system is conscious. The null hypothesis is that your chatbot isn't conscious in any way that matters (I'll happily grant it a slightly-lower-than-thermostat[0] level of consciousness).
I realize it's not easy for you to back up your bold claims, but all I see is a bunch of overconfident CS majors refusing to face up to the hard problem of consciousness[1]. Maybe you are an LLM, after all? Prove you're human: tell me a racist joke? (this question is a joke – something else LLMs are bad at)
Second actually. Are you an LLM since you're having trouble counting?
> Holy shifting the burden of proof, Batman! It's incumbent on you to show that your fancy pattern-matching system is conscious.
No, I never claimed they were conscious, I refuted the claim that we can say with confidence they are definitely not conscious, because such a claim requires knowledge humanity simply doesn't possess. Perhaps you should reread this thread if you're unclear about what I claimed.
> I realize it's not easy for you to back up your bold claims, but all I see is a bunch of overconfident CS majors refusing to face up to the hard problem of consciousness[1]
The hard problem is an alleged problem, there is no proof that it's real. All thought experiments that purport to show its existence (Mary's Room, p-zombies), have acceptable possible answers under physicalist interpretations, and some neuroscientists are now pursuing such theories [1].
[1] https://www.frontiersin.org/journals/psychology/articles/10....
Chairs, chatbots, and internet commenters are subject to a higher degree of scrutiny for their dubious claims of sentience.
This is begging the question. By calling the output of the training "memory" you've proven it has "memory."
I hereby rebut by calling the output of the training "parameters" thereby proving it has no "memory" only "parameters."
>> Whether it has desires, pain or sense of self is completely unknown, unless of course you have some mechanistic model
You probably don't go around saying it's unknown whether your desk chair has "desire, pain or sense of self". The fact tech enthusiasts go around rhetorically demanding "mechanistic models" to rebut their gushing claims about LLMs while not demanding "mechanistic models" while making gushing claims about desk chairs shows a lack of "mechanistic models" is not really the basis of their gushing claims.
Since some types of parameters have the properties we ascribe to memory, then some types of parameters are memory.
> You probably don't go around saying it's unknown whether your desk chair has "desire, pain or sense of self"
I also don't go around having intelligent conversations with chairs.
> The fact tech enthusiasts go around rhetorically demanding "mechanistic models" to rebut their gushing claims about LLMs while not demanding "mechanistic models" while making gushing claims about desk chairs shows a lack of "mechanistic models" is not really the basis of their gushing claims.
I made no such claims, people like yourself who are so eager to dismiss the possibility that LLMs are intelligent or sentient are the ones making strong claims without justification.
Edit: the fact that you are drawing an absurd equivalence between inert chairs and a system capable of intelligent conversation shows you haven't given this topic any serious thought. I suggest you do that and come back with a better analogy if you want to have a serious conversation.
Where's your mechanistic model showing consciousness is linked to "intelligent conversations."
>the fact that you are drawing an absurd equivalence between inert chairs and a system capable of intelligent conversation shows you haven't given this topic any serious thought.
Whether a desk chair has desires, pain or sense of self is completely unknown, unless of course you have some mechanistic model of these phenomena such that we can see its presence in the human brain and see that desk chairs do not have a comparable process.
People like yourself who are so eager to dismiss the possibility that desk chairs are intelligent or sentient are the ones making strong claims without justification.
Denying consciousness exists in systems that also feature sophisticated information processing and that reproduce human capabilities is an argument from ignorance fallacy, unless of course you have additional evidence you haven't presented. Which is not to say that they are conscious either, but I never made such a claim.
Okay.
>argument from ignorance fallacy,
You just conceded we are both ignorant, but I'm the only one making the argument of ignorance fallacy? Double standard?
> Which is not to say that they are conscious either, but I never made such a claim.
Perhaps your objection is the way I phrased my comment. I should have said "ChatGPT being conscious is roughly as plausible as a "hello world" program being conscious. Case in point these model responds much like a "Hello world" program when asked if they are conscious. Claude has been finetuned to say 'I don't know if I'm conscious' Gemini and ChatGPT have been finetuned to say they are not, these models are complex in some ways and not very complex in other ways, they show no sophistication or complexity in ways we would associate with consciousness."
Like, the trick is to distance yourself from your own opinion so as not to be accused of "arguing from ignorance" right? Talk about plausibility instead of directly making claims? But I don't remember making claims either, to be honest, so I'm not sure how I'm the only one making the "argument from ignorance fallacy" allegedly?
If you accept that the only real claim I've made is that we're too ignorant to say definitively whether these systems are or are not conscious (or sentient, or intelligent, etc.), what is the argument from ignorance fallacy that would undermine this position?
> ChatGPT being conscious is roughly as plausible as a "hello world" program being conscious.
Under a scientific interpretation, that's absurd. Of course if you want to go beyond materialism, feel free, but don't pretend it's a scientifically plausible statement.
> they show no sophistication or complexity in ways we would associate with consciousness
I disagree with that claim entirely. LLMs absolutely do exhibit intelligent responsiveness to perceptual stimuli they've been trained on (particularly multimodal LLMs). Text-only LLMs have no perceptions beyond digital word tokens, and as a fairly anemic view of the world they often fail spectacularly at making sense. This is arguably why multimodal LLMs improve accuracy in those scenarios.
> Talk about plausibility instead of directly making claims? But I don't remember making claims either, to be honest, so I'm not sure how I'm the only one making the "argument from ignorance fallacy" allegedly?
It would be fairly strange to start a conversation by drawing an analogy between sophisticated conversational information systems and inert chairs, as you did, without intending to take a fairly clear position on the matter.
Unless it wasn't your intent to dismiss all of the compelling indications of human-level intelligent responses as no more interesting or compelling than a chair that squeaks when you sit down? And it wasn't your intent to take the position that such apparently intelligent responses are a clear reason why one should be compelled to "go around rhetorically demanding "mechanistic models"" before taking a strong position on the presence or absence of consciousness, intelligence, and so on?
I think your implicit claim is it's likely to be conscious, or at least likely enough to be a topic of discussion, since one doesn't generally discuss absurdly unlikely possibilities.
>> ChatGPT being conscious is roughly as plausible as a "hello world" program being conscious. >Under a scientific interpretation, that's absurd.
You've already conceded that Chat GPT may not be conscious. But now you are making the fun argument that if ChatGPT is not conscious, it's still more "scientifically" likely to be conscious than something that is not conscious. Okay.
"Unless it wasn't your intent to dismiss all of the compelling indications of human-level intelligent responses as no more interesting or compelling than a chair that squeaks when you sit down?"
I don't know what "human level intelligent responses" means-- my calculator can do "human level intelligent responses" at multiplication.
I do think these models don't "learn" (they are altered by a training pipeline but that's an outside entity, it's like saying a car is learning when the factory screws it together) and they don't really form memories (the context might be a sort of memory but not one they can use very well- they basically need to be finetuned to do anything with the memory).
A lot of your argument just seems handy wavy anthropomorphism.
It seems like your functional theory of consciousness is "thing that produces plausible English output," which is, I might gently suggest, a bit flawed.
Why is ChatGPT "conscious" for you but DALL-E is not? They're both big honking pattern-matching generators trained on lots of data. Why isn't ELIZA conscious, according to your theory? (or is it?)
My functional theory of consciousness is that it's not at all implausible that any system capable of conversing intelligently might be conscious, which is perfectly reasonable.
> Why is ChatGPT "conscious" for you but DALL-E is not?
I never claimed DALL-E was not conscious. It very well could be as well, just in a different way than ChatGPT.
I'd say a lot of humans qualify as p-zombies.
The problem is, can you ever test for it? To be sure.
I'm not sure, that by the time you have a duplicate human, that it can be achievable without some inner subjective experience.
Put an LLM on a loop and continually learning in a 3d world. Then ask what is going on inside.
What if the effort discussed in the article does find some way to test for this.
But then some humans don't pass?
That said, i suspect my own subjective experience of consciousness may be an illusion. After all, my mind certainly cannot exist outside of my head, and i know that someone or something skillfully tampering with my brain can alter my perception including that subjective experience.
On what basis do you claim that every human (with reasonable exceptions) is a conscious being?
An LLM is an inert pile of data. You could perhaps argue that the process of inference exhibits consciousness, but the LLM itself certainly doesn't. There's simply no there there.
But that's not like saying a human brain is conscious while it does things. A brain is continuously doing a thing, whereas an LLM is either inert at rest or briefy doing a thing before returning to exactly the state it was in beforehand. There is no underlying process that could even conceivably support ongoing consciousness. If there is consciousness, it is present only for the span of its interrogation during an inference, after which it is immediately destroyed.
Now that LLM's are becoming indistinguishable from humans, and other NN's are even solving proofs in geometry competitions. And there are NN that can fly an F-16 better than humans.
All of sudden the goal post moved again.
"No, that is just 'intelligence' not 'consciousness'."
12 months ago, nobody was making this distinction.
We keep needing to redefine the problem to keep humans on top.
This concept of having high intelligence that is not-conscious, or low-intelligence that is conscious. Seems relatively new.
And it did a lot to change my mind. I'm still digesting it.
Before blindsight, I was firmly of opinion that any system that could be at least human level (lets say indistinguishable), then it would also have to have some internal subjective experience. That the internal subjective experience would be another emergent phenomenon. As NN is processing, it would have the same internal awareness as a human brain.
But, after reading blindsight. I am questioning that.
So can we get automatons, that have no thought, but could also become greater than humans? With enough complexity in responses, can they adapt just as easily to new situations.
I'm not really ready to think that is possible.
Only couple years ago, people would argue vehemently that dogs are not conscious. Now it seems as a given that they are, lot of people agree on dogs.
But are cats?
Pigs are 'smarter' than dogs, but nobody cares really about eating them. Are they not conscious. How are we determining dogs are, but pigs aren't?
There were long stretches of time when 'intelligence' was a benchmark for 'consciousness'.
That was ok as long as humans were way far ahead of every other animal.
Suddenly, with AI showing a lot of 'intelligence', now that isn't the measurement we want to use anymore.
But if intelligence isn't the measure of consciousness, and dogs are conscious, then why are we ok with eating animals?
You think I'm making up swaths of people that used to think animals weren't conscious? That couldn't feel pain?
Time Line: ok, I might have date wrong, pre-2000 animals considered not conscious, many to not experience pain. By 2021-2022 there were enough people changing their mind that laws were being changed. It's been slowly shifting over a time range from 2000-2020.
Not sure Mid 2000-2020, versus 2022 really invalidates any of my argument.
https://academic.oup.com/icb/article/40/6/847/187565 https://onlinelibrary.wiley.com/doi/10.1111/mila.12498 https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9704368/
"One representative inventory included imagination, memory, homesickness, self-consciousness, joy, rage, terror, compassion, envy, cruelty, fidelity, and attachment. (See Thompson 1851]"
The ethics of eating something that was once conscious is another thing entirely. Carnivores live by eating other animals. I’m sure there are plenty of animals that would love to eat me :-)
This sentence makes it sound like you believe in 2022 everyone decided dogs are conscious in reaction to the latest shiny toy coming out of silicon valley.
You can find "people" who will argue anything, but I find it very hard to believe dog owners didn't tend to think their dogs were conscious a couple of years ago.
At any rate here's a quote from the Stanford encyclopedia of philosophy:
"In his seminal paper “What is it like to be a bat?” Thomas Nagel (1974) simply assumes that there is something that it is like to be a bat, and focuses his attention on what he argues is the scientifically intractable problem of knowing what it is like. Nagel’s confidence in the existence of conscious bat experiences would generally be held to be the commonsense view and, as the preceding section illustrates, a view that is increasingly taken for granted by many scientists too."
This would suggest sometime between when the encyclopedia article article was written (2016) and 1974 the ideas that animals like bats, cats and dogs are conscious became the majority view. It goes without saying but this has nothing to do with LLMs.
But even before then I find it hard to believe a generation who grew up watching Lassie (1954 to 1973) didn't believe dogs were conscious.
>There were long stretches of time when 'intelligence' was a benchmark for 'consciousness'.
I find that hard to believe? Really, the biological similarity of animals and humans would seem to be the obvious benchmark, not "intelligence" whatever that means.
The encyclopedia of philosophy again says
"Neurological similarities between humans and other animals have been taken to suggest commonality of conscious experience; all mammals share the same basic brain anatomy, and much is shared with vertebrates more generally. Even structurally different brains may be neurodynamically similar in ways that enable inferences about animal consciousness to be drawn (Seth et al. 2005)."
I doubt many of them were reading Nagel or contemplating Stanford studies on this subject.
Maybe you are objecting to 2022 versus slightly earlier, 2016? Is 6 years for public opinion to change really the hang up? In my haste, I had used slang terminology of 'a couple years', and everyone did the math, said that is 2022, and objected to the year 2022? OK. I had the dates wrong. Go with 2016.
Maybe 'dogs' are a bad example, since even the Pope says they go to heaven.
But you can't deny that for Pigs, Cows, Chickens, that up to 2005 and even up to recent years ~2020, it was commonly accepted that they were not conscious, and not intelligent and thus have no ability to experience pain.
Pigs are more intelligent than dogs, but plenty of dog owners eat bacon and don't think twice. So what is the difference? They are both conscious right?
So consciousness is not what we use to provide any moral standing?
The article was about how to 'test' for consciousness. The discussion was, could you apply it to AI. I was simply saying, that for many years 'intelligence' was used as a substitute indicator for consciousness and now that AI is 'intelligent' people were re-defining that indicator.
https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9704368/ https://academic.oup.com/icb/article/40/6/847/187565 https://onlinelibrary.wiley.com/doi/10.1111/mila.12498
I'm not sure if you mean the majority opinion was they are not conscious? If so I do deny this outside of survey data showing otherwise.
I was alive since 1982 and have noticed no cultural shift on this topic. I imagine for most people whether animals are conscious has little to do with whether it's okay to eat them, I recall someone in high school once saying "being a vegetarian is stupid because animals eat other animals."
The U.S. president first pardoned a turkey in 1963 and it's been an annual tradition since 1989. I recall an author possibly making an overly speculative argument linking this to the fact most people in modern times grew up with children's movies like Bambi depicting animals as sentient.
There is definitely a right leaning/religious view that animals are not conscious. And this was the dominant opinion in the US for many decades. When I think back on when I encountered these opinions the most, it was mostly in Midwest and South. When I was living on east coast, there was more opinion's like you are expressing.
Even a few years ago when UK passed laws about squid and lobster. It was right wing pundits that were just howling at how stupid it was since these animals are not conscious.
Guess what we call the 'public', versus what we are exposed to locally, is the real disagreement here.
(I'd say the Turkey thing was a joke, not any indication of sentiment. Probably more a joke about crime, not animals.).
Or was it only the delicious animals they love cooking that aren't conscious?
>The central goal of any C-test is to determine whether a target system has subjective and qualitative experience – often called ‘phenomenal consciousness’.
Phenomenal consciousness is, as far as I can tell, binary. You either have subjective experience or you don't. Even if you are subjectively aware of almost nothing, you still have subjective experience. For example, when you wake up in the morning your awareness might be quite limited for the first few seconds - let's say you have your eyes closed and the only thing you are aware of is the warmness of the blanket. But still, you are aware. You have subjective experience. Whereas in deep sleep you do not.
Phenomenal consciousness is thus pretty well-defined. It's just that we have zero understanding of how physical systems could possibly give rise to it, and it might be in principle impossible to ever figure that out. It is possible that physical systems do not in fact give rise to consciousness, although obviously the presence vs absence of consciousness in humans is at least to some extent correlated with certain measurable physical states.
I doubt that any actual test for consciousness is in principle possible, but the authors of this paper do at least clearly define what they mean when they refer to consciousness. They mean the presence of subjective experience, not intelligence or language or logical thought or having a model of oneself or any other things.
It is right now. We might one day devise a mechanistic explanation for consciousness though, in which case any system that follows that mechanistic process would be conscious.
It's your inner experience. Oh well, you can probably read this in a philosophy textbook. But what I think it really is, can only be explained with a thought experiment.
Lets say you go into a pitch black sensory deprivation tank with salt water, so you can float in the water. Doctors give you injection that makes you forget about who you are, what is your name. You also forget about how to talk, you know no concept of the languge. You simply temporarily forget about you and what makes you really YOU in this world. The cemical in your blood also deprives you of any physical feeling, you don't feel any water around you. All there is to do is to gaze into darkness. And still...you are conscious, you have the inner experience. There is something like to be you, even in that state.
I am honestly not convinced of this. I certainly can't imagine it.
Without any perception or relation to the physical world, and without memory or language, you wouldn't really "exist".
Maybe one thing necessary for having a 'sense of self' is the ability to recognise and reflect on how you relate to other things. The experiment described seems to be implying that having no such relationships but still the ability is enough. I don't think it is.
Following on from this, do LLMs have this ability or is it more likely that they simply appear to?
Even if some form of AI could recognise and reflect on how it relates to other things, what is there to differentiate how it treats relationships between other things and relationships between itself and other things? Could you not just program it to define 'itself' as some other node in that network of relationships, and wouldn't that just invalidate any argument that it ever really has a sense of self?
Obviously I'm just thinking out loud here and assuming that a 'sense of self' is a necessary part of any definition for consciousness.
But i don't find it too comforting.
Surely you mean that the other way around.
Not to get too woo woo on you, but personal experience suggests to me that it is possible to be conscious without having an ego or sense of self and that a state of mind where that is largely absent is characterised by a lack of distinction between the vestigal self and everything else.
I'm not dismissive of the idea that consciousness doesn't necessarily exist 'in the brain' but is in fact a fundamental part of the universe.
What makes me a bit scared is the big unknown.
Probably nothing articulatable. If anything it would be a result of the latter item the fact that your hardware was shaped by millions of years of evolution to experience SOMETHING. An echo round the bones of your hardware specs or a nullity forced into the appearance meaningfulness by our need to find patterns.
The truth is presumably more boring. Consciousness as a modeling toolkit designed to predict the behavior or social peers and enemies turned around on a self too complex for precise monitoring of the totality in real time. A partially out of band control process.
For the technology we have now (LLM)s there does not and will not ever exist a test that can perfectly differentiate between an LLM and any human.
We will always have LLMs that will pass the test and we will have humans that will fail. The reason for this is two fold and contradictory.
The first reason is that consciousness is just a loaded concept. It's some arbitrary category with fuzzy boundaries. One persons definition of consciousness includes language another persons definition of consciousness includes logical thought. It's a made up collection of "features" that's it, no more or no less. It's a very arbitrary set of features too... mashed together for no rhyme or reason.
The second reason is that LLMs already meet the criteria for what most people technically define as consciousness. The resistance we see nowadays is simply moving the goal posts. Five years ago people were in agreement that the turing test was a really good test. We've surpassed that and changed our definitions adding more stringent criteria for sentience. AI already meets the criteria for sentience the way we defined it from 1950-2020. Thus any test to measure sentience will always be a moving target.