News for hackers. Stuff that matters.
Re:Is Consciousness More Like Chess or the Weather? by nl on Sunday May 21, 2023 @07:55PM (#36025789)
> here’s this assumption in and around the AI community that, as AI gets smarter, at some point, maybe the point of general AI—the point at which AI becomes as intelligent as a human being—suddenly the lights come on for the system, and it’s aware. It doesn’t just do things, it feels things.... There may be some forms of intelligence that require consciousness in humans and other animals. But fundamentally they’re different things. This assumption that consciousness just comes along for the ride is mistaken.

Yes.

And yet the pseudo-scientific game theory analysis of Yudkowsky etc never even contemplates this (as well as so many other possibilities outside their toy analysis). It remains astonishing to me that anyone takes them seriously.

Re:Is Consciousness More Like Chess or the Weather? by simonh on Monday May 22, 2023 @01:20AM (#36027733)
I think for consciousness you need a sophisticated mental model of the world, but also a sophisticated mental model of other intentional agents and their mental processes. You need to be able to reason about the knowledge, beliefs and likely actions of others.

When this is generalised to enable modelling and reasoning about our own knowledge, beliefs and intentions, that’s consciousness. We literally become aware of ourselves, our intentions and thought processes recursively in ways we can reason about. So consciousness is a process, an activity. It’s a thing we sometimes do.

I actually don’t think most living things, even animals, are conscious. Mammals and some other higher animals possibly. Simple organisms have simple sense/response nervous systems. Their reactions are mostly automatic, but can learn basic patterns of stimuli.

Re:Is Consciousness More Like Chess or the Weather? by grantcas on Monday May 22, 2023 @11:59AM (#36033106)
It's becoming clear that with all the brain and consciousness theories out there, the proof will be in the pudding. By this I mean, can any particular theory be used to create a human adult level conscious machine. My bet is on the late Gerald Edelman's Extended Theory of Neuronal Group Selection. The lead group in robotics based on this theory is the Neurorobotics Lab at UC at Irvine. Dr. Edelman distinguished between primary consciousness, which came first in evolution, and that humans share with other conscious animals, and higher order consciousness, which came to only humans with the acquisition of language. A machine with primary consciousness will probably have to come first.

What I find special about the TNGS is the Darwin series of automata created at the Neurosciences Institute by Dr. Edelman and his colleagues in the 1990's and 2000's. These machines perform in the real world, not in a restricted simulated world, and display convincing physical behavior indicative of higher psychological functions necessary for consciousness, such as perceptual categorization, memory, and learning. They are based on realistic models of the parts of the biological brain that the theory claims subserve these functions. The extended TNGS allows for the emergence of consciousness based only on further evolutionary development of the brain areas responsible for these functions, in a parsimonious way. No other research I've encountered is anywhere near as convincing.

I post because on almost every video and article about the brain and consciousness that I encounter, the attitude seems to be that we still know next to nothing about how the brain and consciousness work; that there's lots of data but no unifying theory. I believe the extended TNGS is that theory. My motivation is to keep that theory in front of the public. And obviously, I consider it the route to a truly conscious machine, primary and higher-order.

My advice to people who want to create a conscious machine is to seriously ground themselves in the extended TNGS and the Darwin automata first, and proceed from there, by applying to Jeff Krichmar's lab at UC Irvine, possibly. Dr. Edelman's roadmap to a conscious machine is at https://arxiv.org/abs/2105.10461