News for hackers. Stuff that matters.
Re:What Happens When People Don't Understand How AI Works by AlecSchueler on Monday June 09, 2025 @09:46AM (#44224481)
The question is what's different in your own "thinking?"
Re:What Happens When People Don't Understand How AI Works by jhedwards on Monday June 09, 2025 @09:54AM (#44224569)
Thinking in humans is prior to language. The language apparatus is embedded in a living organism which has a biological state that produces thoughts and feelings, goals and desires. Language is then used to communicate these underlying things, which themselves are not linguistic in nature (though of course the causality is so complex that the may be _influenced_ by language among other things).
Re:What Happens When People Don't Understand How AI Works by kenjackson on Monday June 09, 2025 @10:27AM (#44224868)
This is really over indexing on language for LLMs. It’s about taking input and generating output. Humans use different types of senses as their input, LLMs use text.

What makes thinking an interesting form of output is that it processes the input in some non-trivial way to be able to do an assortment of different tasks. But that’s it. There may be other forms of intelligence that have other “senses” who deem our ability to only use physical senses as somehow making us incomplete beings.

Re:What Happens When People Don't Understand How AI Works by jhedwards on Monday June 09, 2025 @11:14AM (#44225336)
Sure, but my whole point is that humans are _not_ passive input/output systems, we have an active biological system that uses an input/output system as a tool for coordinating with the environment. Thinking is part of the active system, and serves as an input to the language apparatus, and my point is that there is no corollary for that when talking about LLMs.
Re:What Happens When People Don't Understand How AI Works by kenjackson on Monday June 09, 2025 @12:21PM (#44226070)
The environment is a place where inputs exist and where outputs go. Coordination of the environment in real time is something that LLMs don’t do much of today although I’d argue that the web search they know perform is the first step.
Re:What Happens When People Don't Understand How AI Works by pixl97 on Monday June 09, 2025 @12:00PM (#44225839)
LLMs use tokens. Tokens don't have to be text, hence multimodal AI. Fee free to call them different senses if you want.
Re:What Happens When People Don't Understand How AI Works by jsdalton on Monday June 09, 2025 @10:02AM (#44224641)
Agreed. Many animals without language show evidence of thinking (e.g. complex problem solving skills and tool use). Language is clearly an enabler of complex thought in humans but not the entire basis of our intelligence, as it is with LLMs.
Re:What Happens When People Don't Understand How AI Works by AlecSchueler on Monday June 09, 2025 @10:42AM (#44225002)
But having language as the basis doesn't mean it isn't intelligence, right? At least I see no argument for that in what's being said. Stability can come from a basis of steel but it can also have a basis of wood.
Re:What Happens When People Don't Understand How AI Works by jibal on Saturday June 14, 2025 @09:10PM (#44279903)
LLMs have no intelligence or problem solving skills and don't use tools. What they do is statistically pattern match a prompt against a vast set of tokenized utterances by humans, who do have intelligence and complex problem solving skills. If the LLM's training data were the writings of a billion monkeys banging on typewriters, any appearance of intelligence and problem solving skills would disappear.
Re:What Happens When People Don't Understand How AI Works by hackinthebochs on Monday June 09, 2025 @10:52AM (#44225115)
Word embeddings are "prior" to an LLMs facility with any given natural language as well. Tokens are not the most basic representational substrate in LLMs, rather it's the word embeddings that capture sub-word information. LLMs are a lot more interesting than people give them credit for.
Re:What Happens When People Don't Understand How AI Works by cma on Monday June 09, 2025 @10:19AM (#44224801)
> which themselves are not linguistic in nature (though of course the causality is so complex that the may be _influenced_ by language among other things).

Its possible something like this could be said of the middle transformer layers where it gets more and more abstract, and modern models are multimodal as well through various techniques.

Re:What Happens When People Don't Understand How AI Works by bsoles on Monday June 09, 2025 @03:36PM (#44228473)
> Thinking in humans is prior to language.

I am sure philosophers must have debated this for millennia. But I can't seem to be able to think without an inner voice (language), which makes me think that thinking may not be prior (or without) language. Same thing also happens to me when reading: there is an inner voice going on constantly.

Re:What Happens When People Don't Understand How AI Works by zeknife on Monday June 09, 2025 @03:45PM (#44228603)
Thinking is subconscious when working on complex problems. Thinking is symbolic or spatial when working in relevant domains. And in my own experience, I often know what is going to come next in my internal monologues, without having to actually put words to the thoughts. That is, the thinking has already happened and the words are just narration.
Re:What Happens When People Don't Understand How AI Works by Bootvis on Monday June 09, 2025 @04:15PM (#44228935)
I too am never surprised by my brains narration but: Maybe the brain tricks you in never being surprised and acting like your thoughts are following a perfectly sensible sequence.

It would be incredibly tedious to be surprised every 5 seconds.

Re:What Happens When People Don't Understand How AI Works by hackinthebochs on Tuesday June 10, 2025 @01:44AM (#44232979)
I never miss a chance to reference this video. A woman vividly describes he experience of not having an inner monologue: https://www.youtube.com/watch?v=u69YSh-cFXY
Re:What Happens When People Don't Understand How AI Works by pennomi on Monday June 09, 2025 @09:51AM (#44224540)
If you actually know the answer to this, you should probably publish a paper on it. The conditions that truly create intelligence is… not well understood.
Re:What Happens When People Don't Understand How AI Works by AlecSchueler on Monday June 09, 2025 @10:44AM (#44225019)
That's actually the point I was making. There's an assumption that the LLM is working differently because there's a statistical model but we lack the understanding of our own intelligence to be able to say this is indeed a difference.
Re:What Happens When People Don't Understand How AI Works by freejazz on Monday June 09, 2025 @10:56AM (#44225154)
So? There is no more evidence to suggest they are the same than what you've already rejected here as evidencing difference.
Re:What Happens When People Don't Understand How AI Works by AlecSchueler on Monday June 09, 2025 @01:01PM (#44226535)
I know but I didn't claim they were the same, I simply questioned the position that they were different. The fact is we don't know, so it seems like a poor basis for building off of
Re:What Happens When People Don't Understand How AI Works by freejazz on Monday June 09, 2025 @03:18PM (#44228264)
Yeah, going either way. Let it not be mentioned at all, imo.
Re:What Happens When People Don't Understand How AI Works by munksbeer on Tuesday June 10, 2025 @07:34AM (#44235504)
To me a more interesting observation, one that is already discussed a lot, is that if eventually we cannot tell the difference between a machine and a human in terms of output, then when do we accept that "thinking" has subjective, rather than objective?
Re:What Happens When People Don't Understand How AI Works by chasil on Monday June 09, 2025 @10:41AM (#44224983)
The platform that we each hold is the most powerful abstract analysis machine known to exist.

It may be, by the end of my life, that this will no longer be true. That would be poignant.

Re:What Happens When People Don't Understand How AI Works by rollcat on Monday June 09, 2025 @12:02PM (#44225852)
Ask a crow, or a parrot. (Really intelligent animals, by the way!)
Re:What Happens When People Don't Understand How AI Works by zahlman on Monday June 09, 2025 @03:35PM (#44228463)
I don't need to be able to qualify it. It's clearly different.

I must believe this to function, because otherwise there is no reason to do anything, to make any decision - in turn because there is no justification to believe that I am actually "making decisions" in any meaningful sense. It boils down to belief in free will.

Re:What Happens When People Don't Understand How AI Works by munksbeer on Tuesday June 10, 2025 @07:32AM (#44235489)
You should read "What's Expected Of Us" by Ted Chiang. Or perhaps you already have. It explores exactly this concept.

For what it's worth, I don't believe we have what people would call free will. Our brains operate either in an entirely deterministic universe, in which case everything was decided and your choices are not in any sense free, or we're in a universe with intrinsic randomness, and randomness doesn't make free will either.

I'm aware of the philosophy of Compatibilism, but this is just a sleight of hand to keep believing in some undefinable concept of free will.