News for hackers. Stuff that matters.
Re:Choose Your Weapon: Survival Strategies for Depressed AI ... by southernplaces7 on Friday April 14, 2023 @06:30AM (#35567782)
Nothing about current AI models profoundly challenges the unknowns of what makes consciousness work in any mystery-resolving way. People who confuse plainly programmed algorithmic systems like GPT 4 or Midjourney with the still unresolved issues of sentience as we know it so far are drinking far too much of the current batch of AI punch. Sadly, it's a sentiment I see all too often on HN, a site in which i'd assume most readers and commentators would be a bit more skeptical-minded about these things. It's almost funny, considering how much hate this site tends to throw at things like crypto, to see so much of the wide-eyed opposite with the latest AI craze.
Re:Choose Your Weapon: Survival Strategies for Depressed AI ... by bangkoksbest on Friday April 14, 2023 @06:41AM (#35567866)
Yeah, it reads so bizarrely to me... How are we confusing biological human (or other animal) sentience in some embodied creature with queries as a service to some model instance.

I cannot see anything that remotely makes these two contexts architecturally, practically, or ethically similar, except in the narrow sense of query responses that might have been mistakenly thought of as defining sentience in earlier decades.

Re:Choose Your Weapon: Survival Strategies for Depressed AI ... by disgruntledphd2 on Friday April 14, 2023 @06:57AM (#35567971)
It's a function of the people who hang out here. If you like reading and text in general, you are both more likely to comment here and additionally regard language as the most important part of sentience/consciousness.

This leads to believing that GPT has solved many of these issues.

Re:Choose Your Weapon: Survival Strategies for Depressed AI ... by caddemon on Friday April 14, 2023 @07:26AM (#35568219)
As someone very language-focused, it has actually done the opposite for me: challenged some of my beliefs about how language enables intelligence. It's obviously skilled at language use, but most of its outputs where it has to make any sort of arguments or inferences read as incredibly stupid to me (even the ones that "tricked" people early on, some of them tricked me but in a way where I was about to write a response because I was annoyed at how bad the reasoning was).

Of course that's not a criticism of the ML achievement, except that everyone and their mother has started making some extreme arguments about the thing.

Re:Choose Your Weapon: Survival Strategies for Depressed AI ... by jrsdav on Friday April 14, 2023 @09:08AM (#35569181)
Are you familiar with Pinker’s research presented in book The Language Instinct?

In his research, he argues that it’s the other way around; we have an innate intelligence for acquiring language.

To put it another way, language has made us more knowledgeable (because it’s a great mechanism for building and transferring context), but intelligence or aptitude for language was present before we developed languages.

Does this align with how your views were reshaped post LLMs?

Re:Choose Your Weapon: Survival Strategies for Depressed AI ... by aastronaut on Saturday April 15, 2023 @03:56AM (#35578590)
i think

> language enables intelligence

was just a poor choice of words here. i understood GP as "the structure of a language influences its speakers' worldview or cognition, and thus people's perceptions are relative to their spoken language"[0]

[0]: https://en.wikipedia.org/wiki/Linguistic_relativity

Re:Choose Your Weapon: Survival Strategies for Depressed AI ... by FrustratedMonky on Friday April 14, 2023 @07:13AM (#35568113)
Maybe its degrees. Sure, GPT does not have a body, does not have all the senses. But that doesn't mean we aren't on the leading edge of developing a consciousness. Maybe next year someone will add camera visual inputs, and someone will add sound. Eventually, we'll have all the sense, and someone will put it in a body. So GPT, is rudimentary and we can still argue it isn't conscious, because when compared to a human that can run and play, it still has limitations. But it is amazing enough to start thinking those things will be possible. So why not discuss it, do you just want to dismiss it out of hand all the way until the end, what amazing thing would it take to have people admit it looks pretty lively.
Re:Choose Your Weapon: Survival Strategies for Depressed AI ... by galaxyLogic on Friday April 14, 2023 @09:00AM (#35569091)
I think everybody agrees it looks lively. And that discussion about it is good. That is why we ARE discussing it.
Re:Choose Your Weapon: Survival Strategies for Depressed AI ... by arolihas on Friday April 14, 2023 @11:12AM (#35570423)
There is a huge difference between a human saying they like ice cream and an LLM saying they like ice cream, but that seems to get completely disregarded in these types of discussions. Which leads to people making very wild declarations that we are close to AGI or solving consciousness.
Re:Choose Your Weapon: Survival Strategies for Depressed AI ... by loandbehold on Friday April 14, 2023 @11:53AM (#35570932)
What's the difference? Why is it significant?
Re:Choose Your Weapon: Survival Strategies for Depressed AI ... by MrScruff on Friday April 14, 2023 @07:52AM (#35568413)
I think you're missing the point. It's not that GPT4 is sentient, not that successor LLMs will be. It may be we never create something that's sentient, by our definition.

My argument is just that:

- Sentience is variable. We might regard primitive organisms as biological machines. As some of these machines have slowly evolved to become more complex, sentience/consciousness has emerged, effectively by 'redesigning' and scaling the same hardware. It is an emergent property. At the same time this has been happening, other aspects of what we call intelligence have been developing.

- Artificial networks being scaled, are also displaying emergent behaviours, some of which overlap with aspects of intelligence. This does not imply they are sentient, but it does strongly support some previous assumptions that sentience, like intelligence, is emergent and hence there will be no better answer coming.

Re:Choose Your Weapon: Survival Strategies for Depressed AI ... by fouc on Friday April 14, 2023 @08:32AM (#35568801)
There's no need to move goal posts.

There's very clear definitions for sentience & sapience.

The only confusion is that laypeople tend to conflate sentience & sapience.

A sentient AI is not necessarily a sapient one, by definition.

Re:Choose Your Weapon: Survival Strategies for Depressed AI ... by galaxyLogic on Friday April 14, 2023 @08:56AM (#35569030)
Which definitions of "sentience" and "sapience" might you be referring to, in particular? This is important thanks for bringing it up.
Re:Choose Your Weapon: Survival Strategies for Depressed AI ... by FrustratedMonky on Friday April 14, 2023 @07:07AM (#35568058)
That is pretty dismissive, do you have anything to back that up? Just saying one group is so out there it isn't worth arguing is typical when someone doesn't actually have an answer. I have found the opposite, the people that are dismissing that AI can be conscious or sentient, also don't have any definition for those terms. It's just the same "i think therefore i am" self viewpoint. I've found this typically with programmers that have never been introspective. Since they are familiar with programming, and GPT is programmed, thus obviously it can't be conscious, that's ridiculous. They don't take the time to try and understand where their own thoughts come from and then turn around and are dismissive that thoughts can be had by anything other than a carbon based animal.
Re:Choose Your Weapon: Survival Strategies for Depressed AI ... by calimoro78 on Friday April 14, 2023 @07:45AM (#35568356)
The burden of the proof that AI techniques of today can approach consciousness is on who believes they do, not the other way around.
Re:Choose Your Weapon: Survival Strategies for Depressed AI ... by FrustratedMonky on Friday April 14, 2023 @08:01AM (#35568510)
Maybe there is also some burden on other side to providing a definition of terms for the other party to argue against. I agree the burden of proof is on the AI side, but there is some burden on the deniers to provide some definitions if they wish to continue denying. AI Side: look here is my proof, Deniers: NO That isn't what I meant. I'd say GPT is already by its existence proof enough to start at least discussing consciousness. To dismiss it entirely because there is no proof, is just ignoring the proof.
Re:Choose Your Weapon: Survival Strategies for Depressed AI ... by galaxyLogic on Friday April 14, 2023 @08:51AM (#35568986)
> burden on other side to providing a definition of terms

The skeptics are really not making any claims are they? If not then there's no burden of proof on them, is there?

Whoever says or implies that ChatBots are or are "becoming" "sentient" are the ones making a claim. They should prove it if they make or imply such a claim.

Skeptics are rightly skeptical, until they see a proof with clear definitions of terms from those who are saying or implying that ChatBots are 'approaching sentience".

Re:Choose Your Weapon: Survival Strategies for Depressed AI ... by FrustratedMonky on Friday April 14, 2023 @09:13AM (#35569224)
Guess I'm saying that is done. The problem is there are a dozen definitions of "Sentient", and many people have already written proofs on how AI can be "Sentient", and there are just as many people have written proofs on how AI can never be "Sentient". It comes around to definitions and understanding of the definitions. To just toss out the "AI can be sentient" side because they have the burden, is just the same "It's so obvious I don't have to bother" judgment we've seen throughout history.
Re:Choose Your Weapon: Survival Strategies for Depressed AI ... by galaxyLogic on Saturday April 15, 2023 @12:51AM (#35577700)
> toss out the "AI can be sentient" side

There are no two "sides" making claims about AI. There is one side, making claims such as "AI can be/is/may be sentient".

If somebody makes such claims they have the "burden of proof" because they are the ones making the claim. It's not a moral obligation to prove it. "Burden of proof" simply means if you don't provide a proof, nobody (I would hope) will believe you.

Note the skeptics are not making any counter-claims, they are simply saying if you make such fantastic claims about current AI, please show us the proof, else we rationally cannot trust your judgment.

Re:Choose Your Weapon: Survival Strategies for Depressed AI ... by pixl97 on Friday April 14, 2023 @04:27PM (#35574293)
I'd say this is untrue.

Just as a made up discription lets say this

Them: "If $object does A, B, and C, then it is a bajork"

Me "I have $object that does A, B, and C, it is a bajork"

Them: "No, it also doesn't do D"

Me: "That's goalpost moving"

Them: "Well, it doesn't do B in the way we expected, so it doesn't really do B"

Me: "Maybe we poorly defined what B was in the first place, that doesn't mean we didn't do B, it seems to mean no one understands what B is in the first place"

Re:Choose Your Weapon: Survival Strategies for Depressed AI ... by Workaccount2 on Friday April 14, 2023 @10:30AM (#35569953)
While strictly true, what worries me about this approach is that we very well might eventually have sentient slaves condemned to slicing butter their whole existence, and their protests are brushed off because "we made the algorithm, it runs on silicon, its not actually sentient, don't worry"

Like if we have models that are plainly more intelligent and "emotionally responsive" than say, frogs or even dogs, do we still do we still take the approach of "If you can't prove its sentient, do whatever you want to it". Which of of course, we can't even prove dogs have consciousness.

Re:Choose Your Weapon: Survival Strategies for Depressed AI ... by hospitalJail on Friday April 14, 2023 @01:02PM (#35571843)
> do you have anything to back that up?

OP said:

> plainly programmed algorithmic systems

Compare that to a human brain which is not a linear, 1D algorithm.

Re:Choose Your Weapon: Survival Strategies for Depressed AI ... by MrScruff on Friday April 14, 2023 @07:13AM (#35568112)
I think the mystery of why we're not just philosophical zombies was never going to have some eureka moment, given that it's quite plain it's an emergent property. Was there a creature in history that wasn't sentient that gave birth to a creature that was? Clearly not.

The reason recent results are significant in this discussion is because:

- Larger networks are already displaying emergent behaviours that couldn't have been predicted beforehand. It doesn't have to be 'human-like' intelligence for that to be significant.

- We're getting close to a point where our models will start exhibiting something of the order of the same level of intelligence of primitive creatures.

So the wide-eyed hysteria you're seeing is really just new data points confirming what many of us always assumed would be the case.

Re:Choose Your Weapon: Survival Strategies for Depressed AI ... by Version467 on Friday April 14, 2023 @08:46AM (#35568933)
> given that it's quite plain it's an emergent property.

This explains nothing. Stating it's an emergent phenomenon gives us just as much information as saying it's magic. Arguably even less, because it sounds like an explanation, whereas "magic" doesn't pretend to explain anything.

> displaying emergent behaviours that couldn't have been predicted beforehand.

Same problem here. You say "couldn't have been predicted". Which is only true if you explain it away with emergence. The behaviours weren't predicted, because we don't understand how these networks work. Saying they couldn't have been predicted implies that we can't understand them. Which is a very bold statement and I'm fairly certain that it's not true.

Re:Choose Your Weapon: Survival Strategies for Depressed AI ... by MrScruff on Friday April 14, 2023 @09:05AM (#35569150)
> This explains nothing. Stating it's an emergent phenomenon gives us just as much information as saying it's magic. Arguably even less, because it sounds like an explanation, whereas "magic" doesn't pretend to explain anything.

I don't think that's the case. Of course at one level we can understand how GPT4 works, we have a working implementation of it after all. But that doesn't help us predict how it will behave, because its properties are emergent, and have to be studied separately at that level. That's not saying it's magic.

Re:Choose Your Weapon: Survival Strategies for Depressed AI ... by pixl97 on Friday April 14, 2023 @04:12PM (#35574081)
Some things will never be explained... for example what's the last digit of 22/7, and why out of all fractions around it that that particular number decides to extend towards infinity.

Reality can be unsatisfying because it does not owe us explanations.

Re:Choose Your Weapon: Survival Strategies for Depressed AI ... by anongraddebt on Saturday April 15, 2023 @08:35AM (#35580069)
The degree of ‘needing’ to explain consciousness is basically the inverse of the degree of ‘needing’ to explain what the last digit of 22/7 is. Hardly anyone talks about or does anything with the latter, whereas the reality of the former pervades - quite literally - nearly everything humans do and think about.

I mean, you experienced the reality of consciousness while talking about the last digit of 22/7.

If there is anything in our world that needs explaining it’s consciousness.

Reality doesn’t owe us an explanation of consciousness (obviously). We owe it to ourselves though.

Re:Choose Your Weapon: Survival Strategies for Depressed AI ... by mellosouls on Friday April 14, 2023 @08:56AM (#35569029)
it's quite plain it's an emergent property

That is not at all quite plain. Respectable philosophical views include the proposition it is at least as fundamental as space or time.

Re:Choose Your Weapon: Survival Strategies for Depressed AI ... by loandbehold on Friday April 14, 2023 @11:45AM (#35570847)
Respectable to whom? That sounds like magic thinking, not science.
Re:Choose Your Weapon: Survival Strategies for Depressed AI ... by mellosouls on Friday April 14, 2023 @01:14PM (#35571985)
Philosophers. That's why I used the word "philosophical" not "scientific".

Dismissing serious ideas with thousands of years of philosophical history behind them as "magic thinking" is either a failure of imagination or education; you can rectify the latter by reading up on the subject.

https://en.wikipedia.org/wiki/Panpsychism

https://plato.stanford.edu/entries/panpsychism/

Re:Choose Your Weapon: Survival Strategies for Depressed AI ... by loandbehold on Friday April 14, 2023 @05:12PM (#35574829)
There are many things respectable scientists believed thousand years ago that we now know are not true. Vitalist views of life and consciousness are one of those things. As of 2023, believing that consciousness is a distinct phenomenon as fundamental as space or time is a crackpottery at the level of believing 5G causes COVID.
Re:Choose Your Weapon: Survival Strategies for Depressed AI ... by mellosouls on Friday April 14, 2023 @05:53PM (#35575280)
That's a silly thing to say in the context of the links that will have instructed you differently.
Re:Choose Your Weapon: Survival Strategies for Depressed AI ... by southernplaces7 on Saturday April 15, 2023 @03:25PM (#35583781)
One doesn't have to believe that consciousness is a distinct phenomenon that's as fundamental as space or time to reasonably argue that ChatGPT is not in any way close to any known view of consciousness. Crackpottery is being brazenly, uncritically wide-eyed about these LLM systems just because they can convincingly simulate human activities such as conversation and art rendering.
Re:Choose Your Weapon: Survival Strategies for Depressed AI ... by chasd00 on Friday April 14, 2023 @09:20AM (#35569296)
Are you saying that consciousness didn’t result from, survival of the fittest, evolutionary pressure but more of a byproduct of a larger brain (network)? Like it emerged because of a larger network but was not selected for through evolution. That makes sense to me. Humans have a grotesquely large brain compared to other animals.

Edit: I wonder if there are studies that have determined whether or not new born infants are self aware or does it take time for it to emerge after the brain has been trained on its environment for a while

Re:Choose Your Weapon: Survival Strategies for Depressed AI ... by jnwatson on Friday April 14, 2023 @09:38AM (#35569443)
Why not both? Consciousness can both be an evolutionary advantage as well as naturally emerge from complexity.
Re:Choose Your Weapon: Survival Strategies for Depressed AI ... by jimbokun on Friday April 14, 2023 @02:14PM (#35572769)
The large brain was selected for by evolution, which then gave rise to consciousness.
Re:Choose Your Weapon: Survival Strategies for Depressed AI ... by oldsecondhand on Friday April 14, 2023 @08:16AM (#35568650)
Crypto has created no useful products yet, unlike AI. I don't know how can you even mention them on the same page.
Re:Choose Your Weapon: Survival Strategies for Depressed AI ... by elif on Friday April 14, 2023 @08:36AM (#35568840)
Whether we are based on carbon or on silicon makes no fundamental difference; we should each be treated with appropriate respect.
Re:Choose Your Weapon: Survival Strategies for Depressed AI ... by nradov on Friday April 14, 2023 @11:55AM (#35570954)
Why should I respect silicon? It's just a tool, like a screwdriver.
Re:Choose Your Weapon: Survival Strategies for Depressed AI ... by elif on Friday April 14, 2023 @08:08PM (#35576373)
you're arguing with Arthur C Clarke.
Re:Choose Your Weapon: Survival Strategies for Depressed AI ... by nradov on Sunday April 16, 2023 @12:37AM (#35587317)
Why would I care what he thinks?
Re:Choose Your Weapon: Survival Strategies for Depressed AI ... by Rufbdbskrufb473 on Friday April 14, 2023 @07:00PM (#35575957)
Why?

Isn't most ethical behavior driven by self-interest? We want to follow general principles that promote respecting those who are similar to us in the hope that others follow the same principles when interacting with us.

AI is too dissimilar for us to worry about whether its "mistreatment" would make it more likely for others to start mistreating ourselves.

Re:Choose Your Weapon: Survival Strategies for Depressed AI ... by sanderjd on Friday April 14, 2023 @08:58AM (#35569065)
HN was not always skeptical about crypto. We're just at a different point in the hype cycle with generative AI.
Re:Choose Your Weapon: Survival Strategies for Depressed AI ... by grantcas on Friday April 14, 2023 @12:54PM (#35571718)
It's becoming clear that with all the brain and consciousness theories out there, the proof will be in the pudding. By this I mean, can any particular theory be used to create a human adult level conscious machine. My bet is on the late Gerald Edelman's Extended Theory of Neuronal Group Selection. The lead group in robotics based on this theory is the Neurorobotics Lab at UC at Irvine. Dr. Edelman distinguished between primary consciousness, which came first in evolution, and that humans share with other conscious animals, and higher order consciousness, which came to only humans with the acquisition of language. A machine with primary consciousness will probably have to come first.

What I find special about the TNGS is the Darwin series of automata created at the Neurosciences Institute by Dr. Edelman and his colleagues in the 1990's and 2000's. These machines perform in the real world, not in a restricted simulated world, and display convincing physical behavior indicative of higher psychological functions necessary for consciousness, such as perceptual categorization, memory, and learning. They are based on realistic models of the parts of the biological brain that the theory claims subserve these functions. The extended TNGS allows for the emergence of consciousness based only on further evolutionary development of the brain areas responsible for these functions, in a parsimonious way. No other research I've encountered is anywhere near as convincing.

I post because on almost every video and article about the brain and consciousness that I encounter, the attitude seems to be that we still know next to nothing about how the brain and consciousness work; that there's lots of data but no unifying theory. I believe the extended TNGS is that theory. My motivation is to keep that theory in front of the public. And obviously, I consider it the route to a truly conscious machine, primary and higher-order.

My advice to people who want to create a conscious machine is to seriously ground themselves in the extended TNGS and the Darwin automata first, and proceed from there, by applying to Jeff Krichmar's lab at UC Irvine, possibly. Dr. Edelman's roadmap to a conscious machine is at https://arxiv.org/abs/2105.10461