News for hackers. Stuff that matters.
Re:Artificial intelligence is not conscious – Ted Chiang by jaggederest on Thursday June 04, 2026 @05:21AM (#48396153)
I'm going to ask a couple dumb but genuine questions:

Does it matter that neurons are more complex than 0-1? Does the fact that transformer layers don't use purely thresholded 0-1 activation invalidate what you're saying?

How do you know that artificial neurons are less capable of producing consciousness than biological ones? How can other people independently verify this?

How does the embodied nature of human consciousness preclude consciousness emerging from a computational system? What is the definition of consciousness if it is precluded from occurring in a computational system but present in biological systems?

Why do you think exactly modeling interaction between atoms matters for consciousness? And where is the fidelity threshold? Is it the planck length?

Finally, a dumb question: how do we know humans are actually conscious, and where is the threshold between consciousness and unconsciousness? And do these criteria exclude all other forms, or other animals?

Re:Artificial intelligence is not conscious – Ted Chiang by suddenlybananas on Thursday June 04, 2026 @07:03AM (#48396909)
>How do you know that artificial neurons are less capable of producing consciousness than biological ones? How can other people independently verify this?

How do you know that toasters or rocks aren't conscious?

Re:Artificial intelligence is not conscious – Ted Chiang by Jtarii on Thursday June 04, 2026 @07:54AM (#48397383)
The only thing you can do is ask rhetorical questions to make your position seem obvious. Which should tell you how little you understand the thing in question.
Re:Artificial intelligence is not conscious – Ted Chiang by suddenlybananas on Thursday June 04, 2026 @09:00AM (#48398050)
My point is it is very difficult to disprove that something has consciousness. What would be sufficient evidence that a rock is not conscious? The onus is on those making extraordinary claims (that a computer program is conscious) to provide evidence for it.
Re:Artificial intelligence is not conscious – Ted Chiang by Jtarii on Thursday June 04, 2026 @11:16AM (#48399959)
>The onus is on those making extraordinary claims (that a computer program is conscious) to provide evidence for it.

By saying that a computer program is not conscious you are also making an extraordinary claim. You would have to hold an agnostic position until there is a test for consciousness.

You are relying on intuitive obviousness and rhetoric to make the opposing side look ridiculous "how could a TOASTER be conscious, preposterous!", you aren't making a actual positive argument for your view.

Re:Artificial intelligence is not conscious – Ted Chiang by suddenlybananas on Thursday June 04, 2026 @12:16PM (#48400790)
Let's say I insist that rocks are conscious and I ask you to disprove that. How would you go about doing that? It's a genuine question.

I assume that we both think rocks are not conscious, but I'm genuinely unsure of how one could prove this.

Re:Artificial intelligence is not conscious – Ted Chiang by Jtarii on Thursday June 04, 2026 @01:18PM (#48401678)
I would agree that a rock is not sentient, but determining whether or not it is conscious would require a definition of consciousness and a machine that could test for it.
Re:Artificial intelligence is not conscious – Ted Chiang by DiogenesKynikos on Thursday June 04, 2026 @10:42AM (#48399436)
LLMs are able to do almost everything that we consider human intelligence, and in many areas of intelligence, they have surpassed us. It's not at all extraordinary to assume they're conscious.
Re:Artificial intelligence is not conscious – Ted Chiang by suddenlybananas on Thursday June 04, 2026 @10:58AM (#48399682)
That's simply not true.
Re:Artificial intelligence is not conscious – Ted Chiang by DiogenesKynikos on Thursday June 04, 2026 @11:27AM (#48400110)
It absolutely is true.

LLMs know more than any human being, are simultaneously experts in nearly every field of science and humanities, are able to make novel mathematical discoveries, can write and understand every major written language, and can give you an intelligent answer to almost any question you pose to them.

How is that not human-level intelligence? If a human could do all of that, we would consider them a genius.

Re:Artificial intelligence is not conscious – Ted Chiang by ikrenji on Thursday June 04, 2026 @02:40PM (#48402852)
it's not very difficult, it's impossible right now. you know you yourself are conscious and that's all that you can prove. you can extrapolate to other people and animals and plants but that's not proof
Re:Artificial intelligence is not conscious – Ted Chiang by calf on Thursday June 04, 2026 @05:36AM (#48396249)
Not the person you were asking but IMHO it all reduces to computational complexity, e.g. biological evolution provided the computational efficiencies that ultimately produced conscious minds and beings, whereas it is not obvious what scale of silicon, power or energy, and input data is sufficient for that to happen artificially. But that means my view is it is a matter of it being possible in principle, merely unknown in practice. Also my view is that denying this amounts to violating the Church Turing thesis of computational equivalence ("human brains are not magic, super-Turing, etc."), and I think a lot of talking-past one another in these public disagreements amounts to one side not actually having taken modern CS theory fundamentals enough to be persuaded of these couple of premises.
Re:Artificial intelligence is not conscious – Ted Chiang by jaggederest on Thursday June 04, 2026 @01:43PM (#48402017)
That's my take on it too, roughly. I think if we get to trillion-parameter models and they don't exhibit what we'd call AGI, however you define it, then the current transformer based systems never will.

But calling them "unconscious" is a pretty high bar. Mice are conscious. The house sparrow pecking in my yard right now is conscious.