News for hackers. Stuff that matters.
Re:There Is No A.I by jackmott42 on Saturday April 22, 2023 @09:09AM (#35666259)
People are using ChatGPT and observing it keep track of conversation state, so if you are going to claim it has no internal state you will need to be more precise in what you are saying, which I suppose is that the underlying neural network is not being updated as we talk to it?

yet

Re:There Is No A.I by Robotbeat on Saturday April 22, 2023 @09:19AM (#35666338)
The attention matrix/matrices are being updated as you talk to it, within the context window.
Re:There Is No A.I by jameshart on Saturday April 22, 2023 @09:25AM (#35666385)
Which is literally internal state.
Re:There Is No A.I by fauxpause_ on Saturday April 22, 2023 @11:37AM (#35667629)
False. They are being updated during the response only.
Re:There Is No A.I by Robotbeat on Saturday April 22, 2023 @01:38PM (#35669025)
Yeah, I was referring to dialogue style interaction, like ChatGPT. It DOES have an internal state depending on version of from 4000 to 32000 tokens. It’s wiped clean between sessions, like a Meeseeks ceasing to exist once its task is finished.
Re:There Is No A.I by fauxpause_ on Saturday April 22, 2023 @10:02AM (#35666709)
That’s external state. I believe it just feeds the bot the entire conversation each time. I’m open to being shown otherwise.

That is to say, swapping out bots midway through the conversation should have no impact.

Re:There Is No A.I by sdenton4 on Saturday April 22, 2023 @10:43AM (#35667045)
There are piles of intermediate hidden activations involved in encoding the conversation and producing the next outputs, of course.

"Internal" state also gets a bit weird as a concept when we can look at any activations we want.

Re:There Is No A.I by fauxpause_ on Saturday April 22, 2023 @11:45AM (#35667719)
We can surely construct a different definition if you want to win a semantic argument. But at the end of the day these LLMs have no clue what you just said and what it just said, after it’s done speaking.
Re:There Is No A.I by sdenton4 on Saturday April 22, 2023 @12:28PM (#35668201)
Why is that a prerequisite for intelligence?

Suppose we could upload + fully simulate a human mind. Now suppose that we chose to spin it up, run it briefly, then throw away all the state every time we wanted to interact with it. Would the choice to throw away the internal state mean it wasn't intelligent?

LLMs run in an autoregressive mode for inference. We can concatenate conversations, but choose not to because shit gets weird if you let them run long enough, and partly because there's a finite context window in the current architectures.

I'm not saying that gpt is intelligent, mind you, but that your argument is insufficient to show non intelligence: it's really a 'airplanes can't fly because they don't flap their wings' argument.

Re:There Is No A.I by fauxpause_ on Saturday April 22, 2023 @01:56PM (#35669221)
A human mind works by cross referencing sensory inputs with internal state, which may result in answering a question through some sort of reasoning, which may resemble the architecture of a neural net.

An LLM is stateless function that answers a question. It constructs a working representation of the question. It cannot be aware of itself because there is nothing to be aware of. It is a process, not a thing.

Intelligence and self aware are fluffy and poorly defined. But you can’t be self aware if you don’t have a self. And a representation of a prompt is not a self. I don’t think we should consider anything that does not exist through continuous time to be intelligent personally.

Re:There Is No A.I by sdenton4 on Sunday April 23, 2023 @02:33AM (#35673865)
Any stateful function can be made stateless by turning the state into an argument to the function and the updated state into an additional return value: y := f(x) becomes y, z' := f(x, z). The usual implementation for LLMs are stateless in exactly this way. The actual operation is autoregressive - ie, stateful and developing over time, where the state is the set of intermediate activations of the network - but it's often expressed as a stateless function to play nice with accelerators. So, on this basic point I think you're confused about how these operate.

Intelligence and self-awareness are distinct concepts.

LLMs work with text - text /is/ their sensorium. New multimodal models process both text and images, and more broadly multimodal models are on their way. But even for text-only LLMs, we can define the text as sensory input, which is combined and cross referenced with state.

And, really, there's two kinds of state: the intermediate model activations and the model weights themselves. Together, these are something like short term and long term memory.

The rest of your arguments are very anthropocentric. Why should continuous time matter for intelligence? That seems entirely arbitrary.

How often do humans apply reasoning to make a decision? Are humans not intelligent when not employing reasoning? Does reasoning require language? And are humans without language intelligent? What about animals? Any definition of intelligence really should spend some time grappling with the facts of animal intelligence...

Is a dead human intelligent? If not, the important part of intelligence would seem to be the process, not the thing/body.

Re:There Is No A.I by fauxpause_ on Sunday April 23, 2023 @10:45AM (#35676677)
Making something “autoregressive” by moving the numbers around doesn’t mean it’s meaningless. A stateless thing is stateless. It has no internal state. It has no self to be aware of.

> Why should continuous time matter for intelligence? That seems entirely arbitrary.

Intelligence is arbitrary. This is a personal view that helps keep it meaningful. If you exist discretely you may as well not exist. You’re just a concept

> How often do humans apply reasoning to make a decision? Are humans not intelligent when not employing reasoning? Does reasoning require language? And are humans without language intelligent? What about animals? Any definition of intelligence really should spend some time grappling with the facts of animal intelligence...

You’re gradually shifting the bar from “self aware” to “capable” and I don’t care about the latter.

Re:There Is No A.I by seventhtiger on Saturday April 22, 2023 @10:51AM (#35667122)
Feeding it the whole conversation again sounds like a perfectly valid way of keeping internal state though. It's part of its thought process.
Re:There Is No A.I by fauxpause_ on Saturday April 22, 2023 @11:37AM (#35667626)
That is the opposite of internal state. That is stateless.

F(x) is just a function without any dependence on state.