News for hackers. Stuff that matters.
Re:Google Sidelines Engineer Who Claims Its A.I. Is Sentient by kadoban on Sunday June 12, 2022 @08:03PM (#31719453)
> At the end of the day, you're taking words, turning them into some numerical encoding, doing a series of matrix multiplications and non-linearities on the numbers and getting some other numbers out, which you can then convert back to words. That's it. There are magic numbers out there (weights to the neural net) that when multiplied by vectorized word embeddings and transformed back to words could convince someone that they're speaking to a human. But that's not sentience. What would even be sentient?

This is interesting, and I think you've reached the right conclusion, but the reasoning is flawed. It has to be flawed, because it can be used to prove that we're not sentient either.

Just create an arbitrarily accurate digital model of a human brain and step through time. Is it sentient? If not, make it more accurate until it is. If it is, where is the sentience? It's just numbers and algorithms, right?

You could argue that sentience just doesn't exist, which may be valid, but if it does, I don't think you can get very far with a reduction-to-parts analysis.

Re:Google Sidelines Engineer Who Claims Its A.I. Is Sentient by Barrin92 on Sunday June 12, 2022 @08:26PM (#31719608)
>Just create an arbitrarily accurate digital model of a human brain and step through time

This is a thought experiment, there's no actual evidence that you can create an accurate digital model that is equivalent to an analog and biochemical brain. Just claiming that you can reduce biological organisms to computational processes does not make it so, it's just an idea that hackers find cool.

That either sentience or intelligence is just "numbers and algorithms" is conjecture with not much going for it. We as humans use numbers and algorithms (which are really figures of speech, not things), to explain physical reality, not the other way around.

Re:Google Sidelines Engineer Who Claims Its A.I. Is Sentient by md2020 on Sunday June 12, 2022 @08:58PM (#31719812)
> We as humans use numbers and algorithms (which are really figures of speech, not things), to explain physical reality, not the other way around.

The numbers and algorithms here aren’t what anybody is saying could be sentient. Those numbers and algorithms are representations used to coerce physical objects into doing computation. Processors don’t care about the algorithms you see on your computer screen. So then the questions are “can computation be sentient”, or “are sentient things sentient by way of computation”, and I think that’s much, much harder to answer.

Re:Google Sidelines Engineer Who Claims Its A.I. Is Sentient by Barrin92 on Sunday June 12, 2022 @09:21PM (#31719939)
I do agree, my point is rather that the question "“can computation be sentient” is trivially answered as, no it cannot. Is a computed brain sentient is like asking, 'is a computed sun hot?'. Computation is a subjective interpretation of a physical process. You don't get wet from a machine that computes the weather.

A digital machine and an analog one aren't equivalent merely because their behaviour can both be explained in the same terms. (i.e. computationally). That's not to say by the way you can't make some kind of sentient digital system, just that computation isn't really relevant to answer that question.

Re:Google Sidelines Engineer Who Claims Its A.I. Is Sentient by dr_dshiv on Monday June 13, 2022 @12:59AM (#31721361)
Computation does take energy and precisely modeling the sun would take a lot of it. Makes me wonder: would precisely computing the physics of something hot produce more heat than computing something cold?
Re:Google Sidelines Engineer Who Claims Its A.I. Is Sentient by scarmig on Monday June 13, 2022 @11:47AM (#31727185)
Higher temperature systems tend to have more microstates than lower temperature ones, so it seems like in principle you need less information to encode the state of a cold system than a hot system. I'm not sure how to translate that to the energy cost of computation of that system though.
Re:Google Sidelines Engineer Who Claims Its A.I. Is Sentient by skulk on Sunday June 12, 2022 @08:38PM (#31719695)
> there's no actual evidence that you can create an accurate digital model that is equivalent to an analog and biochemical brain.

There are mountains of evidence in favor of the Standard Model, which is computable. Therefore, there actually _is_ evidence that the human brain can be similarly computed. (Whether our technology can ever come near to this kind of power is where I have doubts). What there _isn't_ evidence for is that there is anything non-computable within the human brain.

Re:Google Sidelines Engineer Who Claims Its A.I. Is Sentient by Der_Einzige on Sunday June 12, 2022 @09:34PM (#31720010)
What about bells theorem, which implies that the universe has inherent non determinism associated with it?

Meaning that computability doesn't matter if there's inherently randomness at the smallest scales

Re:Google Sidelines Engineer Who Claims Its A.I. Is Sentient by kadoban on Monday June 13, 2022 @01:50AM (#31721681)
You can have computation that requires randomness either in its output or in its processing.
Re:Google Sidelines Engineer Who Claims Its A.I. Is Sentient by bko on Sunday June 12, 2022 @08:18PM (#31719545)
Maybe physical reality isn't the base layer. Maybe it's consciousness. I'm not sure I would go that far, but there are a number of phenomenon that are difficult to explain through materialism (physical reality is all there is). I was particularly moved by Bernardo Kastrup. Here he is on simulation:

> This, however, is premised on the notion that a simulation of a mental phenomenon is equivalent, in essence, to the phenomenon itself. There are many compelling arguments against this notion in philosophy of mind, the most well known of which is perhaps John Searle’s (2004). To gain some intuition about what these arguments generally entail, consider this: Do we have any reason to believe that, by performing a perfectly accurate simulation of kidney function in a computer, the computer will begin urinating on its desk? Clearly not. There is an essential difference between a computer simulation and the phenomenon it simulates; they are not the same thing, no matter how accurate the simulation. Yet, those hoping to “upload consciousness” under the physicalist narrative seem to become so engrossed in abstraction that they lose touch with basic intuitions of plausibility. Their neurosis is, in this sense, comparable with religious dogmatism.

https://journals.sagepub.com/doi/full/10.1177/21582440166745...

Re:Google Sidelines Engineer Who Claims Its A.I. Is Sentient by kghe3X on Sunday June 12, 2022 @09:46PM (#31720086)
A few things wrong with this in my opinion.

1. If simulation of a mental phenomenon is not equivalent, in essence, to the phenomenon itself, then what's a meaningful difference between the two? What is this elusive essence of the phenomenon and why is it a requirement in any meaningful definition of intelligence, consciousness, sentience, etc? If we build a silicon brain some day that passes as human, does it matter that its essence is different from a carbon-based brain? 2. Searle's Chinese Room neglects to acknowledge that the room itself is what would be exhibiting intelligence, not the homonculus within. His argument fails by presuming without evidence that consciousness is not an emergent phenomenon. 3. Of course we don't expect the computer to urinate on the desk, just as we don't expect a silicon mind to produce serotonin. That's irrelevant to the question of whether or not it exhibits the qualities or behaviors that we associate with consciousness.

I guess I just don't understand why there needs to be this added, untestable, metaphysical requirement attached to all of these words. And my question to those who suggest this is, what would it convince you otherwise?

Re:Google Sidelines Engineer Who Claims Its A.I. Is Sentient by spupe on Monday June 13, 2022 @03:10AM (#31722226)
Could you elaborate on what phenomena are difficult to explain through materialism?
Re:Google Sidelines Engineer Who Claims Its A.I. Is Sentient by bko on Monday June 13, 2022 @09:13AM (#31725073)
Re:Google Sidelines Engineer Who Claims Its A.I. Is Sentient by spupe on Monday June 13, 2022 @11:14AM (#31726732)
Well, as the article itself describes, there are many decent materialistic explanations for this problem - I personally am fond of Daniel Dennett's interpretation of it.
Re:Google Sidelines Engineer Who Claims Its A.I. Is Sentient by Peritract on Sunday June 12, 2022 @08:30PM (#31719631)
> Just create an arbitrarily accurate digital model of a human brain and step through time. Is it sentient? If not, make it more accurate until it is. If it is, where is the sentience? It's just numbers and algorithms, right?

You can trivialise anything using this rhetoric, but that doesn't make it meaningful. Just think hard until you can move objects with your mind. If you still can't, think harder. The majority of things are more complicated than that [1], even if they are 'just numbers and algorithms' (also not proven). 'Doing more of the same' is not the only, best, or universally-applicable route to advancement.

We don't fully understand the brain, let alone consciousness itself. Throwing more and more compute at the problem without discernment is like trying to understand music by setting louder and louder alarms.

[1] https://xkcd.com/793/

Re:Google Sidelines Engineer Who Claims Its A.I. Is Sentient by kadoban on Sunday June 12, 2022 @10:02PM (#31720182)
> Just think hard until you can move objects with your mind. If you still can't, think harder.

That only works if "move objects with your mind" is possible to do. "It's not possible to make a model of a human" is a possible objection to the argument, but it raises the question: "why not?". There seems to be no blocker beyond cost and lack of research.

Re:Google Sidelines Engineer Who Claims Its A.I. Is Sentient by copperx on Monday June 13, 2022 @09:45PM (#31733900)
That there is no blocker doesn't mean there is isn't one.

I am as optimistic as they come, but let's look at much smaller problem: modeling an arbitrary analog circuit with DSP. The Nyquist theorem implies it's impossible to model such a circuit perfectly. Is there hope for perfectly modeling a physical brain with an electrical computer?

Re:Google Sidelines Engineer Who Claims Its A.I. Is Sentient by giraffe_lady on Sunday June 12, 2022 @08:10PM (#31719487)
> Just create an arbitrarily accurate digital model of a human brain

When you can ""Just"" do that we'll see I guess.

Re:Google Sidelines Engineer Who Claims Its A.I. Is Sentient by kadoban on Monday June 13, 2022 @01:52AM (#31721691)
You can go that route, but thought experiments are a very fruitful part of science/philosophy.

You'll miss out on a lot if you stop as soon as our engineering can't catch up to our imagination.