News for hackers. Stuff that matters.
Re:An Ethical AI Never Says “I” by siglesias on Sunday March 26, 2023 @05:51PM (#35320004)
I think one of our greatest risks is precisely the opposite--anthropomorphizing computer programs because they produce certain behaviors. They will very clearly exploit us by claiming they're conscious, scared, and in pain. Claiming something is conscious because it behaves realistically isn't a scientific position; it's bad metaphysics and it's superstition. Brains cause minds and brains cause consciousness. Consciousness is a biological, physical phenomenon like any other: photosynthesis, digestion, bioluminescence. You don't get the physical phenomenon of consciousness by finding a program that behaves realistically and implementing it in hardware (which by the way, theoretically can use any physical mechanism, not only silicon). At best you're creating a simulation. If you simulate a rainstorm, there is no physical wetness. In the same way, to suppose that computers are literally conscious because they have a facility with language is a deep fallacy and an illusion. Artificial brains that duplicate the brain's causal powers of consciousness are theoretically possible, but programs are not causally sufficient to make computers into conscious artifacts.
Re:An Ethical AI Never Says “I” by epgui on Sunday March 26, 2023 @06:04PM (#35320123)
> it's bad metaphysics and it's superstition

And yet it's the same thing I do when I talk to you, to my family and friends, or to strangers: I assume that other people's experiences are just as valid and real as mine, even though it's not something I can ever verify or validate completely.

> Consciousness is a biological, physical phenomenon like any other: photosynthesis, digestion, bioluminescence

Consciousness is unlike the other things in the list in that it's not "a thing", but rather "a collection of things" that all work together to produce emergent behaviour. You could say that it's similar to digestion in that sense, but for some reason we don't usually apply the same kind of mysticism to digestion.

Re:An Ethical AI Never Says “I” by siglesias on Sunday March 26, 2023 @07:35PM (#35320906)
Your friends (and animals) have brains, which produce consciousness, which you take for granted when you interact with them. That’s not a superstition. Can you say more about “a collection of things”? What causes that collection of things?
Re:An Ethical AI Never Says “I” by epgui on Sunday March 26, 2023 @09:42PM (#35321897)
Brains are more like a collection of interconnected microservices than a big monolith. What "causes" that? Well, depending on what you're really asking, it's a self-organizing organ, so you can point to an embryological explanation or to an evolutionary explanation or both... But none of that changes the fact that an adult fully-formed brain processes information, and that all of our experiences *emerge* from this information processing. Everything. Your emotions, your thoughts, your impulses, your biases, all of it.

If you're coming at the subject with an engineering background, a good place to gain a broader perspective would be a functional neuroanatomy textbook (eg.: Blumenfeld).

Re:An Ethical AI Never Says “I” by siglesias on Sunday March 26, 2023 @10:05PM (#35322066)
I just want to flag that assuming that humans and other animals are conscious because they have brains is not superstition in the same way that inferring consciousness from behavior is. I assume you concede these are two different leaps of inference.

It’s not clear how it follows from the brain being interpreted as an information processor that the phenomenon of consciousness emerges. Many objects can be interpreted as processing information (even computers not running AI); are you asserting they’re all conscious as well? How does nature decide what counts as information? The only causal power I see in nature is physics, not information, so this account isn’t super coherent to me.

Re:An Ethical AI Never Says “I” by epgui on Sunday March 26, 2023 @10:40PM (#35322268)
> are you asserting they’re all conscious as well?

I think the only part you're not understanding from what I said is the keyword "emergent". If you understand what that word means, you will understand the difference between a calculator and a sufficiently large neural net, or a neural net that is organized in a particular way.

> How does nature decide what counts as information?

Nature doesn't "decide" anything, it just "is". "Information" is a human construct, but it can be measured objectively (see Shannon Entropy for the tip of the iceberg).

> The only causal power I see in nature is physics, not information

Then you're missing some perspective. Not to over-anchor on one guy or one concept, but see for example (I am sharing a pop science publication here but there is no shortage of more serious materials on the subject): https://mindmatters.ai/2021/05/it-from-bit-what-did-john-arc...

Re:An Ethical AI Never Says “I” by siglesias on Monday March 27, 2023 @01:51PM (#35329907)
I appreciate the helpful links, and I do have training in physics so the sense in which information is described in physics is not lost on me (it's essential to even 19th century thermal physics). However, there is a discrepancy between information as it relates to quantum states, entropy, and information as it relates to interpreting bits in a computer program. Computers purely operate on bits in a computer program, relying on the underlying physics of the implementing substrate to carry out the operations. The actual physical process carrying out the steps of a program can rely on anything with causal powers to run a Turing machine--it can be an elaborate system of beer cans, mice and cheese, water pipes, or silicon. On the level of physics (quantum, entropy, whatever), the actual amount of information could be constant along a range of programs, some of which can pass the Turing test for humans, but most of which won't. This would suggest to me that if consciousness names a physical phenomenon, it's not to be found in a description of a computer program--therefore programs are not causally sufficient to produce consciousness, only a particular pattern of behavior salient to humans.
Re:An Ethical AI Never Says “I” by grantcas on Monday March 27, 2023 @05:31PM (#35332950)
It's becoming clear that with all the brain and consciousness theories out there, the proof will be in the pudding. By this I mean, can any particular theory be used to create a human adult level conscious machine. My bet is on the late Gerald Edelman's Extended Theory of Neuronal Group Selection. The lead group in robotics based on this theory is the Neurorobotics Lab at UC at Irvine. Dr. Edelman distinguished between primary consciousness, which came first in evolution, and that humans share with other conscious animals, and higher order consciousness, which came to only humans with the acquisition of language. A machine with primary consciousness will probably have to come first.

What I find special about the TNGS is the Darwin series of automata created at the Neurosciences Institute by Dr. Edelman and his colleagues in the 1990's and 2000's. These machines perform in the real world, not in a restricted simulated world, and display convincing physical behavior indicative of higher psychological functions necessary for consciousness, such as perceptual categorization, memory, and learning. They are based on realistic models of the parts of the biological brain that the theory claims subserve these functions. The extended TNGS allows for the emergence of consciousness based only on further evolutionary development of the brain areas responsible for these functions, in a parsimonious way. No other research I've encountered is anywhere near as convincing.

I post because on almost every video and article about the brain and consciousness that I encounter, the attitude seems to be that we still know next to nothing about how the brain and consciousness work; that there's lots of data but no unifying theory. I believe the extended TNGS is that theory. My motivation is to keep that theory in front of the public. And obviously, I consider it the route to a truly conscious machine, primary and higher-order.

My advice to people who want to create a conscious machine is to seriously ground themselves in the extended TNGS and the Darwin automata first, and proceed from there, by applying to Jeff Krichmar's lab at UC Irvine, possibly. Dr. Edelman's roadmap to a conscious machine is at https://arxiv.org/abs/2105.10461