News for hackers. Stuff that matters.
Re:OpenAI's employees were given two explanations for why Sa... by dwaltrip on Monday November 20, 2023 @11:37PM (#38359315)
LLMs predict language, and language is a representation of human concepts about the world. Thus, these models are constructing, piece by piece, conceptual chains about the world.

As they learn to construct better and more coherent conceptual chains, something interesting must be happening internally.

Re:OpenAI's employees were given two explanations for why Sa... by mvdtnz on Tuesday November 21, 2023 @12:01AM (#38359511)
No they are not.
Re:OpenAI's employees were given two explanations for why Sa... by cjbprime on Tuesday November 21, 2023 @12:53AM (#38359899)
(You're probably going to have to get better at answering objections than merely asserting your contradiction of them.)
Re:OpenAI's employees were given two explanations for why Sa... by diffeomorphism on Tuesday November 21, 2023 @03:45AM (#38361061)
Nah, calling out completely baseless assertions as just that is fine and a positive contribution to the discussion.
Re:OpenAI's employees were given two explanations for why Sa... by mirekrusin on Tuesday November 21, 2023 @01:47AM (#38360223)
Intelligence is just optimization over recursive prediction function.

There is nothing special about human intelligence threshold.

It can be surpassed by many different models.

Re:OpenAI's employees were given two explanations for why Sa... by krisoft on Tuesday November 21, 2023 @03:41AM (#38361033)
Your carefully constructed argument is less than convincing.

Could you at least elaborate what they are “not”? Surelly you are not having a problem with “LLMs predict language”?

Re:OpenAI's employees were given two explanations for why Sa... by denton-scratch on Tuesday November 21, 2023 @05:37AM (#38361879)
> LLMs predict language, and language is a representation of human concepts about the world. Thus, these models are constructing, piece by piece, conceptual chains about the world.

I smell a fallacy. Parent has moved from something you can parse as "LLMs predict a representation of concepts" to "LLMs construct concepts". Yuh, if LLMs "construct concepts", then we have conceptual thought in a machine, which certainly looks interesting. But it doesn't follow from the initial statement.

Re:OpenAI's employees were given two explanations for why Sa... by aezart on Thursday November 23, 2023 @01:10AM (#38389890)
Language is only one projection of reality into fewer dimensions, and there's a lot it can't capture. Similar to how a photograph or painting has to flatten 3D space into a 2D representation, so a lot is lost.

I think trying to model the world based on a single projection won't get you very far.