News for hackers. Stuff that matters.
Re:There Is No A.I by fauxpause_ on Saturday April 22, 2023 @11:44AM (#35667706)
If I talk to Alice about my day, and then Bob reads the transcript and I ask him about our conversation, and he has no idea that he wasn’t Alice, Bob does not have internal state. He can continue the conversation. There is a brief moment of constructing some state to construct the answer. But there is literally nothing persisting and Bob wouldn’t flinch at all if we change details in the conversation history on the next response.

This is explicitly a stateless function.

Re:There Is No A.I by jackmott42 on Saturday April 22, 2023 @01:54PM (#35669192)
just zoom out and consider the text box you are typing in part of the system, and then that text box is the state.
Re:There Is No A.I by fauxpause_ on Saturday April 22, 2023 @01:58PM (#35669238)
That is at best an internal state representation of the text, not of the entity on the other end.
Re:There Is No A.I by FeepingCreature on Saturday April 22, 2023 @03:04PM (#35669882)
This is a misleading analogy because Bob "reads the transcript"; we generally view "reading" as separate from our conscious narrative. However, consider the alternate scenario where Bob "replays the stream of consciousness" from Alice. In that case, we may argue that Bob has conscious continuity from Alice.

The argument would then be that the context window is functionally closer to "replaying a stream of consciousness" than "reading a transcript".

Re:There Is No A.I by fauxpause_ on Saturday April 22, 2023 @04:41PM (#35670730)
It’s literally the text. It is not a stream of consciousness. There is no carryover of “consciousness” state. It is the raw text without even the embedding information, not that we should consider the embedding representation to be an internal state, because it is not.

That difference is the whole point. There is nothing to transfer.

Re:There Is No A.I by FeepingCreature on Sunday April 23, 2023 @03:38AM (#35674182)
Humans verbalize their conscious state. What little consciousness GPT has, ie. CoT and the like, it picked up by imitating human verbalization of conscious interiority. (I don't think layer state qualifies as consciousness.) As such, I believe two things: 1. the generated text is, if at all, very weak conscious state; 2. if there is any, it is there.
Re:There Is No A.I by fauxpause_ on Sunday April 23, 2023 @10:47AM (#35676686)
Any definition that tries to claim your response here is consciousness is wrong and uninteresting to me. It is subjective either way.
Re:There Is No A.I by grantcas on Sunday April 23, 2023 @01:20PM (#35678275)
It's becoming clear that with all the brain and consciousness theories out there, the proof will be in the pudding. By this I mean, can any particular theory be used to create a human adult level conscious machine. My bet is on the late Gerald Edelman's Extended Theory of Neuronal Group Selection. The lead group in robotics based on this theory is the Neurorobotics Lab at UC at Irvine. Dr. Edelman distinguished between primary consciousness, which came first in evolution, and that humans share with other conscious animals, and higher order consciousness, which came to only humans with the acquisition of language. A machine with primary consciousness will probably have to come first.

What I find special about the TNGS is the Darwin series of automata created at the Neurosciences Institute by Dr. Edelman and his colleagues in the 1990's and 2000's. These machines perform in the real world, not in a restricted simulated world, and display convincing physical behavior indicative of higher psychological functions necessary for consciousness, such as perceptual categorization, memory, and learning. They are based on realistic models of the parts of the biological brain that the theory claims subserve these functions. The extended TNGS allows for the emergence of consciousness based only on further evolutionary development of the brain areas responsible for these functions, in a parsimonious way. No other research I've encountered is anywhere near as convincing.

I post because on almost every video and article about the brain and consciousness that I encounter, the attitude seems to be that we still know next to nothing about how the brain and consciousness work; that there's lots of data but no unifying theory. I believe the extended TNGS is that theory. My motivation is to keep that theory in front of the public. And obviously, I consider it the route to a truly conscious machine, primary and higher-order.

My advice to people who want to create a conscious machine is to seriously ground themselves in the extended TNGS and the Darwin automata first, and proceed from there, by applying to Jeff Krichmar's lab at UC Irvine, possibly. Dr. Edelman's roadmap to a conscious machine is at https://arxiv.org/abs/2105.10461