News for hackers. Stuff that matters.
Re:LaMDA is not sentient by orbital-decay on Monday June 13, 2022 @02:03AM (#31721754)
> To be sentient is to be aware of yourself in the world

A robotic arm with a self-collision avoidance algorithm (no ML or anything like that) needs a model of itself in the "world" it exists in; a set of bounding boxes at least. Is it self-aware by this definition?

Sentience and consciousness are really ill-defined terms so everyone discusses this under their own arbitrary set of assumptions, at least that's my impression.

Re:LaMDA is not sentient by tsimionescu on Monday June 13, 2022 @02:44AM (#31722044)
I think sentience/consciousness are relatively clear concepts, at least in most areas of application (there are serious problems at the edges - e.g. is a an insect conscious? if you think it is, how about a jelly fish? if that too, how about a bacterium? a virus?).

However, our understanding of this concept is too limited to create a formal model that we can define satisfactorily; and coming up with an arbitrary model that fits some of our intuitions is silly. This is what the Integrated Information Theory people did, and I find it closer to economic models than to actual science - a nice little abstraction that can give you the appearance of being rigorous while in fact speculating wildly.

On the other hand, I think it's fair to say there are some decently well understood must-haves for something to match our idea of sentience - and being aware of yourself in the world is one of them; and yes, in that sense, it makes more sense to talk about the robot arm as being sentient, as simple as it is, than it is to say that about LaMDA or GPT-3. Of course, the robot arm is missing other per-requisites for sentience - it's programming is far too rigid, and it has no introspection.

Re:LaMDA is not sentient by rendall on Monday June 13, 2022 @02:58AM (#31722136)
> I think sentience/consciousness are relatively clear concepts

Not at all!

When we say conscious, do we mean awake or self-aware or recognizes self in mirror or something else? When we say sentient do we mean feels or intelligent or trapped in the wheel of reincarnation and suffering or something else? When we say intelligent, do we mean completes tasks or uses language or...?

Re:LaMDA is not sentient by tsimionescu on Monday June 13, 2022 @03:45AM (#31722453)
The fact that the word "conscious" is a synonym for several concepts is entirely irrelevant to this conversation.

The concept that we can't yet capture formally is the kind of sentience that living, awake humans surely have, most animals probably have, and rocks definitely don't have. The limits of this are harder to pin down, as, again, we lack a deep formal understanding.

But we do know exactly what we'd like to formally model.

Re:LaMDA is not sentient by rendall on Monday June 13, 2022 @04:11AM (#31722625)
> "But we do know exactly what we'd like to formally model"

Do we really? I thought it was a deeply intractable problem for cognitive theorists and other such experts.

Haven't you ever encountered a challenge that you at first thought was straight-forward and obvious to solve, but after digging in find it was unexpectedly nuanced and difficult?

> "The limits of this are harder to pin down, as, again, we lack a deep formal understanding."

Doesn't that contradict?

If you were to try pinning down precisely what you mean by "the kind of sentience that living, awake humans surely have, most animals probably have, and rocks definitely don't have", I suspect it will not be nearly as easy as you think.

How do you know rocks don't have it, for instance? How do you know you do, for that matter?

Re:LaMDA is not sentient by tsimionescu on Monday June 13, 2022 @04:44AM (#31722810)
> How do you know rocks don't have it, for instance? How do you know you do, for that matter?

These are both part of the (incomplete) definition I gave you.

There have been problems like this before in the history of science - we have concepts that we intuitively understand, and want to give a formal definition for. This can take a long time of careful study - such as coming up with a complete definition for "insect". Other times it can indeed turn out that the concept was ill-defined - there is no possible formal definition for the concept "fish" that doesn't appeal to the human mind (the various organisms we think of as fish are too diverse genetically to find a satisfactory one-to-one mapping with any group of animals, even if you exclude a small set of them, like the aquatic mammals).

Re:LaMDA is not sentient by rendall on Monday June 13, 2022 @06:36AM (#31723478)
Ok. I'm responding to the statement that these are "relatively clear concepts". AI will by definition never have "the kind of sentience that living, awake humans have" (and I do acknowledge that this is only a working definition) because the goalposts will continue to move according to whim in the absence of a more formal definition. I remember when one prevailing formal test of self-awareness was "independently claiming to have self-awareness". There were caveats, of course, but that goalpost has evidently moved.
Re:LaMDA is not sentient by int_19h on Monday June 13, 2022 @03:07PM (#31730150)
We do know what it means for ourselves to be sentient.

We do not know how to translate it to anything outside of ourselves. That's why it's not readily formalizable.

Re:LaMDA is not sentient by rendall on Monday June 13, 2022 @05:05PM (#31731760)
Yes! Descartes helped us to understand our own sentience. I can accept the proposition that because I think, I am.
Re:LaMDA is not sentient by busyboy on Monday June 13, 2022 @05:26PM (#31731973)
Thoughts are not necessary for existence.
Re:LaMDA is not sentient by tsimionescu on Monday June 13, 2022 @05:33PM (#31732060)
"Because I think, I am" implies more that existence is necessary for thoughts, which is true. If you didn't exist, you couldn't think.
Re:LaMDA is not sentient by busyboy on Monday June 13, 2022 @05:49PM (#31732225)
"Because I think, I am" just implies that I exist because I think. This implies that thoughts are a necessity for existence. I am saying that is not the case and thoughts are not a necessity for existence. What you inferred, although true, is not the correct implication of the statement.
Re:LaMDA is not sentient by tsimionescu on Monday June 13, 2022 @05:57PM (#31732301)
I was reading it more similarly to "Since I think, I am" which would be closer to "I think therefore I am" than to "I am because I think", though perhaps that's giving it too much slack, or perhaps its coming from a native language where word order is more flexible than in English.
Re:LaMDA is not sentient by busyboy on Monday June 13, 2022 @06:12PM (#31732435)
Got it.
Re:LaMDA is not sentient by int_19h on Monday June 13, 2022 @05:57PM (#31732306)
Natural language is vague and allows for many possible interpretations of short phrases. The one that is more applicable to Descartes quote is something along the lines of "me thinking proves that I exist". This, of course, says nothing about thoughts being a necessity for existence.
Re:LaMDA is not sentient by busyboy on Monday June 13, 2022 @06:12PM (#31732432)
Got it. Now, it makes sense.
Re:LaMDA is not sentient by rendall on Tuesday June 14, 2022 @08:05AM (#31737906)
Yeah, sorry I missed all of this. I agree that thinking is almost certainly not necessary to exist. I probably could have written it more as "Because I think, I can be certain that I exist"
Re:LaMDA is not sentient by tidenly on Monday June 13, 2022 @05:42AM (#31723114)
The problem is that lots of people who have never done any introspection, or looked into the discussions in the field of artificial sentience, will draw completely arbitrary lines in the sand for what "cannot be sentient".

I took issue with the article saying sentience requires an "awareness of the world" too. I think it self-evident that a humans sentience doesn't disappear when we remove sensors like sight, or touch, or sound - it just means their experienced world is different from the world. In the end, I only really feel confident saying sentience requires probably some perception, and information processing.

A sense of self also feels right, like it should be necessary, to me - but again depending on what senses we give to a thinking entity, its reasonable it may not have enough sensory information to create a concept of self vs other, while still being able to process information intelligently, ""think"" and learn.

There are lots of other arguments above saying Lambda can't be sentient because it doesn't experience human emotions, fear, self-presevation, and doesn't run until prompted. However I think those are again all sensory choices and implementation details, which avoid the actual question of what sentience as an emergent behaviour is, and how we could ever detect it.

These are age-old questions experts in the field still argue about, it's sad to me how over-confidently a lot of the above repliers are in their lack of consideration to the problem at hand.

Re:LaMDA is not sentient by perlgeek on Monday June 13, 2022 @03:20AM (#31722294)
> I think sentience/consciousness are relatively clear concepts, at least in most areas of application

If you think that, try to come up with a black-box test that determine if something or someone is sentient / conscious.

I think that it is pretty clear to US that WE are sentient, and it's pretty clear to us that block of silicon isn't sentient, because it's so different from us, and because it doesn't make a sad face when we're mean to it -- but that assumes that our form of sentience is the only one that counts.

The article quotes a tweet saying

> It is mystical to hope for awareness, understanding, common sense, from symbols and data processing using parametric functions in higher dimensions.

but that is all our brains do, really.

How can we claim that a computer doing the same kinds of computations that we do is fundamentally different? This just reeks of human exceptionalism.

Re:LaMDA is not sentient by lapinot on Monday June 13, 2022 @05:02AM (#31722912)
> > It is mystical to hope for awareness, understanding, common sense, from symbols and data processing using parametric functions in higher dimensions.

> but that is all our brains do, really.

> How can we claim that a computer doing the same kinds of computations that we do is fundamentally different? This just reeks of human exceptionalism.

Our brains and physiological mechanisms are far more complex than matrix multiplications sprinkled with some tan or max(0,x). I'm ok with saying that we are big machines etc, but the power of our primitive operations, the range in aspect and behaviors of our mechanisms is far far greater than what is currently done in NN. The complexity of what is learned in NN, seen as a computer program, seems to me to be at the level of a full-text-search index together with a probabilistic automaton. What i believe we are as humans (and other "very sentient" animals) is more on the level of linux: tons of subsystems each looking very different, tons of "drivers" for accomplishing very specific tasks rapidely.

Re:LaMDA is not sentient by sudosysgen on Monday June 13, 2022 @12:21PM (#31727643)
Matrix multiplication with some non-linear functions, memory, and persistent internal state is Turing Complete, so there is no reason it couldn't eventually be used to implement an AI, as long as such a thing is at all possible.
Re:LaMDA is not sentient by lapinot on Monday June 13, 2022 @01:47PM (#31728894)
Universal models of computations are still distinguishable by their complexity classes. Every universal model can simulate the others but these simulations may not be practical. The whole insane teraflop showoff of the big players of NN is fun and all (saddening actually) but at some point everyone has a limit. Then you have to think about how to get qualitative improvement, and since ML basically boils down to optimizing in computable function spaces just take a better computation model. If you're keen on gradient descent take some language of computable derivable functions (there are richer ones than finite space linear functions + some primitives). Cf Conal Elliott talking about how getting stuck on the idea of matrix operation graph is completely stupid (among other things): "A Functional Reboot for Deep Learning".
Re:LaMDA is not sentient by tsimionescu on Monday June 13, 2022 @03:43AM (#31722437)
> If you think that, try to come up with a black-box test that determine if something or someone is sentient / conscious.

As I said, we don't understand such things at a deep enough level to come up with formal models of them. But we do know what it is that we'd want to model. We do know for sure that humans and other mammals are sentient, while rocks are not.

I also can't generate a black box test that will predict whether something is porn, but that doesn't mean I don't understand what porn is, or that it is some deep mystery.

Re:LaMDA is not sentient by XorNot on Monday June 13, 2022 @05:23AM (#31723010)
> but that doesn't mean I don't understand what porn is

You only understand what it is for you. The history of complete failures with regard to obscenity laws makes it quite clear though that this is not sufficiently common to produce satisfactory definitions at a societal level.

You are mistaking the overlap of opinion you share within your social cohort with some sort of objective, species wide truth.

Re:LaMDA is not sentient by mikkergp on Monday June 13, 2022 @01:08PM (#31728368)
Knowing that gravity is much more complex than “the thing that causes an apple to fall to the earth” doesn’t not make gravity the thing that causes an apple to fall to the earth.
Re:LaMDA is not sentient by eecc on Monday June 13, 2022 @02:25AM (#31721913)
We have no clue and probably to a certain extent even cows and pigs are sentient. I guess we’ll never know and probably aren’t even that eager to do, lest we had to rethink how we feed and please our palates.
Re:LaMDA is not sentient by upwardbound on Monday June 13, 2022 @02:31AM (#31721961)
Yes definitely; cows and pigs are absolutely considered sentient by the vast majority of those who study the topic.

See https://en.wikipedia.org/wiki/Animal_consciousness

We have empirical tests of self-awareness including the Mirror Test as well as observational studies including seeing whether a certain species displays grieving when its loved ones pass (which is evolutionarily unnecessary but is meaningful emotionally).

Re:LaMDA is not sentient by cortic on Monday June 13, 2022 @03:58AM (#31722530)
>evolutionarily unnecessary

Grieving is an evolved response to nomadic group species, so we didn't leave useful or closely related members behind; In their absence we feel compelled to 'search' for them, or be near their carcass. Its interesting how this evolved impulse has been adapted into ritual by our developing ability to understand mortality; But its not really special in any self-awareness kind of sense.

Re:LaMDA is not sentient by dqpb on Monday June 13, 2022 @01:54PM (#31728979)
Surely consciousness can be gradient no? The more complete or complex your self-model and environment model are, the more conscious you are.
Re:LaMDA is not sentient by yummybear on Monday June 13, 2022 @05:29AM (#31723045)
But that’s not “awareness” - that’s an if-statement.