News for hackers. Stuff that matters.
Re:Claude 4 by jrmg on Thursday May 22, 2025 @08:06PM (#44068481)
LLMs are the Chinese Room. They would generate identical output for the same input text every time were it not for artificially introduced randomness (‘heat’).

Of course, some would argue the Chinese Room is conscious.

Re:Claude 4 by scarmig on Thursday May 22, 2025 @08:10PM (#44068500)
If you somehow managed to perfectly simulate a human being, they would also act deterministically in response to identical initial conditions (modulo quantum effects, which are insignificant at the neural scale and also apply just as well to transistors).
Re:Claude 4 by elcritch on Thursday May 22, 2025 @10:22PM (#44069264)
It's not entirely infeasible that neurons could harness quantum effects. Not across the neurons as a whole, but via some sort of microstructures or chemical processes [0]. It seems likely that birds harness quantum effects to measure magnetic fields [1].

0: https://www.sciencealert.com/quantum-entanglement-in-neurons... 1: https://www.scientificamerican.com/article/how-migrating-bir...

Re:Claude 4 by andrei_says_ on Thursday May 22, 2025 @10:33PM (#44069335)
Doesn’t everything act deterministically if all the forces are understood? Humans included.
Re:Claude 4 by andrei_says_ on Thursday May 22, 2025 @10:34PM (#44069343)
Doesn’t everything act deterministically if all the forces are understood? Humans included.

One can say the notion of free will is an unpacked bundle of near infinite forces emerging in and passing through us.

Re:Claude 4 by defrost on Thursday May 22, 2025 @10:41PM (#44069373)
> in response to identical initial conditions

precisely, mathematically identical to infinite precision .. "yes".

Meanwhile, in the real world we live in it's essentially physically impossible to stage two seperate systems to be identical to such a degree AND it's an important result that some systems, some very simple systems, will have quite different outcomes without that precise degree of impossibly infinitely detailed identical conditions.

See: Lorenz's Butterfly and Smale's Horshoe Map.

Re:Claude 4 by scarmig on Friday May 23, 2025 @12:48PM (#44074405)
Of course. But that's not relevant to the point I was responding to suggesting that LLMs may lack consciousness because they're deterministic. Chaos wasn't the argument (though that would be a much more interesting one, cf "edge of chaos" literature).
Re:Claude 4 by defrost on Friday May 23, 2025 @09:14PM (#44078047)
Sure .. all the same it's always worth emphasizing that neither the tumbling of a tennis racket under gravity nor the axis flipping of a spinning wingnut in an orbiting satellite are deterministic in any predictive sense no matter how well initial conditions are measured ... they are only "deterministic" given out of band god like powers.

Clearly you're aware of this, however I find that the majority of casual referrers to determinism are not.

Re:Claude 4 by anorwell on Thursday May 22, 2025 @08:27PM (#44068577)
I am arguing (or rather, presenting without argument) that the Chinese room may be conscious, hence calling it a fallacy above. Not that it _is_ conscious, to be clear, but that the Chinese room has done nothing to show that it is not. Hofstadter makes the argument well in GEB and other places.
Re:Claude 4 by mensetmanusman on Thursday May 22, 2025 @09:38PM (#44069020)
The Chinese room has no plane of imagination where it can place things.