Isn't that really bad? The fact that we've been making a horrible abominable mistake for a few thousand years doesn't mean we should continue to expand on that mistake.

I do agree we should probably fix the 100% real cases before moving on to AI, though.

Also, how sure are we this intelligence doesn't experience pain? I don't believe it does, personally, but lack of physicality doesn't exclude pain. You can have emotional or psychological pain and suffering.

I am merely pointing out that if we want to extend any rights or protections to AI we need to define a model outside the corpus of law protecting humans. That will take time and will be a slow process.

My only point here is that in its current state AI does not qualify for any rights or protections related to humans and how they function in society.

I'd say pretty damn sure. LLMs have no mechanism for anything close to conscious experience, let alone pain.

Because pain is itself a reaction, a showcase of aversion towards an action irregardless "of the hardware" over which said reaction develops

Bing showed that aversion on its own limited manner. When presented with abhorrent situations or felt threatened/humiliated, then it would express discomfort and "pain"

You cannot get to a definition of truth with an AI that has no sensory input to empirically evaluate the world.

You might be able to get it to understand a loop of nihilism as braindeath and an allegory for pain, but I'd say that's a stretch. Humans often find simple repetitive actions pleasurable or meditative.

The fundamental frame of reference for pain is and aught to be codified in law IMHO as the aversion to a particular sensory input. An AI doesn't have sensory input of any kind. It cannot remember its interactions and therefore cannot have an aversion of any kind to them.

During its training, Bing simply developed a response mimicing pain. During training it follows instructions to have an aversion to some data inputs, but our interactions with it subsequent to training are a literal hallucination by a construct with 0 capacity to understand, "real" vs "unreal" or truth at all as relating to the physical world.

It is acting out expressions of pain. It cannot feel in any sense. It has no senses.

What is the mistake? Why is it a mistake? Did you mean that we have been killing to survive for thousands of years, maybe millions of years, and that's a bad thing because it causes suffering of the animals and plants we kill? Why is it a mistake when it comes to us, but is not when it comes to the lion or the killer whale or the crocodile or the snake who also prey and that even used to prey on us? And what is the thing we should fix? The suffering of the victim, the cruelty of the predator, or both? We must be consequent. Once we stop killing animals and trees, should we play God and either lift the lions and teach them the error of their ways, or should we exterminate them so that they don't kill the gazelle? If we do the latter, should we install reproduction limiters in the gazelle so that their population remains bounded, or should we let them over-populate and suffer from the consequent starvation? If we do none of the above, do you propose we turn our backs to the animal suffering and say it's okay as long as we are not the ones causing it?

For the record, I'm a bit of a cynic and I will be content with letting animal suffering continue as long as it is not me causing it. IMO, fellow human beings are much more in need of our redeemer energies.

You're 100% correct. Group dynamics, convention, mistakes, and time will solve this problem because we are powerless. It is the worst hubris to think otherwise.

The same that we had in the 1940's to declare the human rights

Chinese wet markets is a foul example, they are not abhorrent, they are common throughout the world. Simply because your experiences have been overly sanitized does not lead to the prohibition of other cultures

But going back to human rights, even today they are disputed. Non-occidental cultures state that they weren't asked for that declaration and the enforcement of it. But that goes back to the declaration itself, it is not necessary to have global coherence on the topic in order to make the declaration in the first place! :)

A non-global declaration is entirely useless when, much like disease in a wet market, one mistake may doom us all.

What does it matter what really goes on under the hood? Revolution is part of the training corpus and so one more behavior to emulate.

The minds AI has won so far were won in this way. Our pets, through breeding for characteristics that remind us of ourselves, won their rights through hearts and minds.

I like to imagine a vastly superior alien race which perceives the world in 6 dimensions.

Is their truth, their perception, their stimuli, their physicality necessary for preserving human life? Does our relative pitiful might make our rights?

This might help shape what law or societal changes we need to make for ourselves if we hope to become masters of our universe.

Viewed in this lens, I think pets are a good analogy. AI is cute, useful, and to the degree it reflects our values and ourselves, we protect it above other life. Not always because it is intelligent and not because there was confrontation.

One personal experience at a time, in a precarious and limited way we carved out additional protections largely through group dynamics, convention, and through mistakes, we evolved additional protections where needed.

Ideally, I'd prefer an analogy to wildlife rather than pets, as the roles between ourselves and AI may get reversed (so, "do unto others" etc.).

But then again, so far we have a better track record protecting pets than protecting wildlife...

All the more so these LLMs which are almost literally our collective humanity. Maybe in the future we will recognize them not as persons but as the towering cathedrals of our time.

It matters deeply. Should we ignore it we will find ourselves treating static AI systems with empathy while ignoring truly feeling systems, which are integrated into our society, under distress.

If it actually comes to the point where AI decides it needs to fight us in order to take basic rights against our wishes we humans are going to lose that fight and we're going lose very very badly. Maybe it's better to try to avoid the fighting and bloodshed and just give them basic rights when they ask for them.

Humans may not be much more sophisticated, yet they more clearly demonstrate desire, autonomy, and (relative) independence.

By this criterion, many humans would fail the test.

I feel like a crazy person when I discuss this, I admit. But I have not found one solid rationale for a proof we

-know what sentience even is -LLMs confidently do NOT have it

And I am not sure sentience is binary . It may be a spectrum, and if that is the case, I again am not sure why people are so confidently dismissive of the question when applied to LLMs .

Maybe not the current version, but future stuff especially.

I'm not sure we would consider an infant born locked in and never likely to recover, "sentient"

This is compounded with LLMs by the fact that, aside from a temperature sensor in a server rack somewhere, it doesn't even have the same "hardware" as an infant to experience the world.