News for hackers. Stuff that matters.
Re:I disagree with Geoff Hinton regarding "glorified autocom... by jeffparsons on Saturday November 18, 2023 @11:38PM (#38329027)
Serious question, in pursuit of understanding where you're coming from: in what way do you think that your own reckoning is fundamentally different to or more "real" than what you're describing above?

I know I don't experience the world as it is, but rather through a whole bunch of different signals I get that give me some hints about what the real world might be. For example, text.

Re:I disagree with Geoff Hinton regarding "glorified autocom... by Guvante on Sunday November 19, 2023 @12:32AM (#38329431)
You understand the concept of true vs false.

LLM does not, that isn't how it works.

You can say the difference is academic but there is a difference.

What is the difference between a real good faker of intelligence and actual intelligence is an open question.

But I will say most AI experts agree that LLM are not artificial general intelligence. It isn't just a lack of training data, they just are not of the category that we mean by that.

Re:I disagree with Geoff Hinton regarding "glorified autocom... by xcv123 on Sunday November 19, 2023 @04:28AM (#38330844)
> You understand the concept of true vs false.

> LLM does not, that isn't how it works.

GPT-4 can explain the concept when prompted and can evaluate logic problems better than most human beings can. I would say it has a deeper understanding of "true vs false" than most humans.

I think what you are trying to say is that LLMs are not conscious. Consciousness has no precise universally agreed formal definition, but we all know that LLMs are not conscious.

Re:I disagree with Geoff Hinton regarding "glorified autocom... by weebull on Sunday November 19, 2023 @05:13PM (#38338878)
> GPT-4 can explain the concept when prompted and can evaluate logic problems better than most human beings can. I would say it has a deeper understanding of "true vs false" than most humans.

Sigh

GPT produces output which obeys the patterns it has been trained on for definitions of true and false. It does not understand anything. It is a token manipulation machine. It does it well enough that it convinces you, a walking ape, that it understands. It does not.

Re:I disagree with Geoff Hinton regarding "glorified autocom... by xcv123 on Sunday November 19, 2023 @05:43PM (#38339267)
A human is an ape that is obeying patterns that it has been trained on. What is school but a bunch of apes being trained to obey patterns? Some of these apes do well enough to convince you that it understands things. Some apes fully "understand" that flat earth theory is true, or they "understand" that the Apollo moon landings were faked.

You have a subjective philosophical disagreement about what constitutes understanding. That is fine. I clearly understand it is not conscious and that programs do not understand things the way that humans do. We are fundamentally different to LLMs. That is obvious. But you are not making a technical argument here unless you can define "understand" in technical terms. This is a matter of semantics.

> It is a token manipulation machine

Deep learning and machine learning in general is more than token manipulation. They are designed for pattern recognition.

Re:I disagree with Geoff Hinton regarding "glorified autocom... by Guvante on Monday November 20, 2023 @10:03PM (#38358499)
You acknowledged above that consciousness isn't what LLM is and you likely understand that the poster was referring to that...

The broad strokes you use here are exactly why discussing LLMs are hard. Sure some people dismiss them because it isn't general AI but having supporters dismiss any argument with "passes the Turning test" is equally useless.

Re:I disagree with Geoff Hinton regarding "glorified autocom... by xcv123 on Monday November 20, 2023 @10:35PM (#38358775)
No you have misunderstood. As I wrote above:

"But you are not making a technical argument here unless you can define "understand" in technical terms. This is a matter of semantics."

I said the nature of their argument is not technical, since they are not dealing with technical definitions, but I did not dismiss their argument altogether. I clarified and restated their own argument for them in clearer terms. LLMs are not conscious, but they can still "understand" very well depending on your definition of understand. Understanding is not a synonym for consciousness. Language is evolving and you need to be more precise when discussing AI / machine learning.

One definition of understand is:

"perceive the intended meaning of (words, a language, or a speaker)."

Deep learning models recognize patterns. Mechanical perception of patterns. They understand things mechanically, unconsciously.

Re:I disagree with Geoff Hinton regarding "glorified autocom... by Guvante on Tuesday November 21, 2023 @11:46AM (#38366147)
I stand by my point that people using synonyms for consciousness being told "LLM knows true better than humans do" is bad for discussion.

The core issue is their "knowledge" is too context sensitive.

Certainly humans are very context sensitive in our memories but we all have something akin to a "mental model" we can use to find things without that context.

In contrast LLM has knowledge defined by that context quite literally.

In either case my original point on using true and false is that LLM can hallucinate and on a fundamental design level there is little that can be done to stop it.

Re:I disagree with Geoff Hinton regarding "glorified autocom... by xcv123 on Tuesday November 21, 2023 @12:14PM (#38366610)
I disagree. My point was to show that their thinking, reasoning and language was flawed, that it lacked nuance and rigor. I am trying to raise the standards of discussion. They need to think more deeply about what "understanding" really means. Consciousness does not even have a formal universally agreed definition. These LLMs can outperform humans on a variety of tasks that require understanding. Formally, they are designed to solve "natural language understanding" tasks. The word "understanding" is used in the academic context here. It is a standard term in NLP.

Sloppy non-rigorous shallow arguments are bad for discussion.

Re:I disagree with Geoff Hinton regarding "glorified autocom... by Guvante on Wednesday November 22, 2023 @02:50AM (#38376235)
Except that if you narrow to a tiny training set you are back to problems that can be solved almost as quickly with full text search...
Re:I disagree with Geoff Hinton regarding "glorified autocom... by xcv123 on Wednesday November 22, 2023 @04:50AM (#38377159)
Narrow to a tiny training set? What are you talking about now? That has nothing to do with deep learning.

GPT-3.5 was trained on at least 300 billion tokens. It has 96 layers in its neural network of 175 billion parameters. Each one of those 96 stacked layers has an attention mechanism that recomputes an attention score for every token in the context window, for each new token generated in sequence. GPT-4 is much bigger than that. The scale and complexity of these models is beyond comprehension. We're talking about LLMs, not SLMs.

Re:I disagree with Geoff Hinton regarding "glorified autocom... by Guvante on Wednesday November 22, 2023 @11:52AM (#38381676)
I misread context window as training set and thought you were switching to SLMs. My mistake.
Re:I disagree with Geoff Hinton regarding "glorified autocom... by edflsafoiewq on Sunday November 19, 2023 @03:06AM (#38330325)
In order to affirm something is true, you don't just need to know it, you need to know that you know it. LLMs fundamentally have no self-knowledge.
Re:I disagree with Geoff Hinton regarding "glorified autocom... by xcv123 on Sunday November 19, 2023 @04:21AM (#38330796)
> LLMs fundamentally have no self-knowledge

ChatGPT can tell me about itself when prompted. It tells me that it is an LLM. It can tell me about capabilities and limitations. It can describe the algorithms that generate itself. It has deep self knowledge, but is not conscious.

Re:I disagree with Geoff Hinton regarding "glorified autocom... by user_named on Sunday November 19, 2023 @07:31AM (#38332061)
LLMs only knows it's text embeddings. It does not know the real world. Clear?
Re:I disagree with Geoff Hinton regarding "glorified autocom... by xcv123 on Sunday November 19, 2023 @01:36PM (#38336046)
Humans and other creatures only know their sensory data input. Therefore they also don't know the real world.

Your eyes and ears perceive a tiny minuscule fraction of what is out there in the real world.

A blind and deaf person must know even less of the real world than an LLM, which can read more than a human can ever read in their lifetime.