News for hackers. Stuff that matters.
Re:New research suggests our brains use quantum computation by jqpabc123 on Thursday October 20, 2022 @07:44AM (#33273201)
GPT-3 already writes code if you ask nicely

And yet, both the binary logic software and the playback device following the script are completely unaware of what they are doing or why. In terms of consciousness, they are as dumb as a hammer.

In other words, any "consciousness" in this is strictly limited to the author of the software and those who interpret the results. Otherwise, on it's own, it has no impact on reality. An ant comes way closer to exhibiting self awareness and consciousness.

Re:New research suggests our brains use quantum computation by ben_w on Thursday October 20, 2022 @07:58AM (#33273333)
Would you like to have a go at defining "consciousness"? ;)
Re:New research suggests our brains use quantum computation by jqpabc123 on Thursday October 20, 2022 @08:14AM (#33273473)
Sure --- independent thought and action, self awareness and motivation --- all the things that inanimate objects lack and will/have never aquired.
Re:New research suggests our brains use quantum computation by ben_w on Thursday October 20, 2022 @08:38AM (#33273703)
> independent thought

What is a thought, if not a pattern of information that in humans is embodied in the energy flowing though our neurons, and which finds an analogy in the information flow though an artificial neural network?

Are human thoughts really any more independent than any self-learning process that happens to be implemented in silicon? What makes the tiny warm bags of chemicals that are our cells, special?

> self awareness

Can you define this in a way that it simultaneously (1) is something that humans do actually have, and (2) is not trivially accomplished by giving an AI access to its own state, whether by internal feedback loops in a neutral net, by embodiment in a real or simulated environment where it can sense its own embodiment as another agent in that environment, or by other similar means?

> motivation

Internal states within an agent which create a disposition to engage in specific actions?

I definitely don't need much to pass that test: both (original 1993) Doom and bacterial cells demonstrate this.

Re:New research suggests our brains use quantum computation by jqpabc123 on Thursday October 20, 2022 @09:02AM (#33274037)
Are human thoughts really any more independent than any self-learning process that happens to be implemented in silicon?

Yes. It's called "creativity" and "independent thought" --- not programming.

What makes the tiny warm bags of chemicals that are our cells, special?

Maybe quantum physics? This remains to be fully answered but their "specialness" compared to silicon/sand is not in doubt.

Re:New research suggests our brains use quantum computation by ben_w on Thursday October 20, 2022 @09:10AM (#33274149)
> It's called "creativity" and "independent thought" --- not programming.

The AI under discussion here are no more programmed than you or me. The architecture of our brains comes from our DNA, an artificial neutral net from hyperparameters, but in both cases the interesting stuff is learned. The billions of parameters in GPT-3 and DALL•E 2 etc. are beyond the means of humans to program.

Edit:

> Maybe quantum physics? This remains to be answered but their "specialness" compared to silicon is not in doubt.

Quantum computers exist. They are no more animate than classical computers. Would you expect to change your mind if you saw an AI running on a quantum computer, or would you expect to continue to insist that brains are special?

Edit edit:

Can you define "creativity" without reference to any of the other things you're trying to use to define consciousness?

Re:New research suggests our brains use quantum computation by melenaboija on Thursday October 20, 2022 @08:40AM (#33273713)
What about defining self awareness?

Defining consciousness as being self aware sounds like a circular definition to me and the crux of the problem.

And don’t get me wrong as this is my intuition too but your definition did not convince me.

Re:New research suggests our brains use quantum computation by FeepingCreature on Thursday October 20, 2022 @08:23AM (#33273568)
I submit that a roomba set to an automatic schedule is conscious under your definition.
Re:New research suggests our brains use quantum computation by jqpabc123 on Thursday October 20, 2022 @08:45AM (#33273800)
I submit there is nothing independent about what a roomba does. It is following a script just like very other piece of software ever written. It doesn't know or care that the result cleans your floor.
Re:New research suggests our brains use quantum computation by ben_w on Thursday October 20, 2022 @08:54AM (#33273937)
Our bodies implement a script, which is our genome. We didn't know or care about that code for the first (million?) years [0], and most of us still don't.

Indeed, this lack of awareness of (and lack of regard for) the lower level of our nature, is why we were very happy to invent birth control, and why the people who get upset about the existence of it are seen by the rest of us as a bit odd.

[0] Depends what you count as a human/person/creature with consciousness, which is of course the point of this thread. Yay for blurry lines!

Re:New research suggests our brains use quantum computation by jqpabc123 on Thursday October 20, 2022 @09:32AM (#33274446)
Our bodies implement a script, which is our genome.

Our genome is not a script --- more like a blueprint.

Once construction is finished, the thoughts and actions of your mind/body are not "scripted" --- unless you *believe* in pre-determination.

Re:New research suggests our brains use quantum computation by ben_w on Thursday October 20, 2022 @09:53AM (#33274715)
That also describes GPT-3. The hyperperameters are a blueprint.

If you don't want to count the data flow in a human brain as "scripted", you can't count the data flow in an artificial neural network as scripted; if you do count the ANN as scripted, then you should also count brains as such.

Current AI are, it is worth pointing out, less complex than a human brain: GPT-3 is appropriately the same number of parameters as a rat has synapses, while DALL•E 2 is approximately a honey bee. But the argument you're making has not yet touched scale.

Re:New research suggests our brains use quantum computation by jqpabc123 on Thursday October 20, 2022 @10:38AM (#33275393)
That also describes GPT-3. The hyperperameters are a blueprint.

Can it diagnose my car engine? It seems to be idling rough and it's using too much gas.

Re:New research suggests our brains use quantum computation by ben_w on Thursday October 20, 2022 @10:49AM (#33275583)
> Can it diagnose my car engine?

Probably.

My free credit has run out and I've not gotten around to setting up a payment method for more credit, but this kind of random question is the kind of thing it's surprisingly good at.

Re:New research suggests our brains use quantum computation by jqpabc123 on Thursday October 20, 2022 @12:21PM (#33276989)
Can it really *diagnose* it --- or will it just put together a technically correct and properly structured reply that may sound kinda plausible to the uninformed but which lacks any real insight?

The distinction here tends to highlight the difference between real intelligence and programming.

Re:New research suggests our brains use quantum computation by ben_w on Thursday October 20, 2022 @01:24PM (#33277872)
> will it just put together a technically correct and properly structured reply that may sound kinda plausible to the uninformed but which lacks any real insight?

Most humans would fail this standard. (Hence the memes "Never read the comments!" and "Eternal September" and widespread beliefs in paranormal and so on).

The (surprising to me) difference is that GPT-3 generally does a bit better than, e.g. Hollywood script writers when facing similar prompts.

Re:New research suggests our brains use quantum computation by ben_w on Friday October 21, 2022 @08:48AM (#33287438)
Too late to edit the other content, but I think this is a perfect example of humans just putting "together a technically correct and properly structured reply that may sound kinda plausible to the uninformed but which lacks any real insight" when asked to draw a bicycle from memory:

https://www.mensjournal.com/adventure/people-asked-to-draw-b...

Re:New research suggests our brains use quantum computation by FeepingCreature on Thursday October 20, 2022 @09:23AM (#33274316)
I certainly hope to never operate independent of my brain and its script! That would be quite worrying.

Would the Roomba be conscious if it had a dust sensor? Then it would know that the result cleans the floor.

Re:New research suggests our brains use quantum computation by jqpabc123 on Thursday October 20, 2022 @09:44AM (#33274605)
I certainly hope to never operate independent of my brain and its script!

Are you a robot? Speaking strictly for myself, my brain does not follow a script. I normally operate on my own --- like when I formulated this reply to you.

Re:New research suggests our brains use quantum computation by tux3 on Thursday October 20, 2022 @10:27AM (#33275181)
Next, we may expand the length of this thread threefold by asking you to describe free will, and what it would take under the definition of free will you pick (none of which are very satisfying) for a bio system to not have free will, or for a machine to have it
Re:New research suggests our brains use quantum computation by FeepingCreature on Thursday October 20, 2022 @09:55AM (#33274743)
I am indeed a meat robot.

I think this is at risk of becoming a debate over the word "script". Is it a matter of complexity? Is GPT-3 a script? Is Windows a script, even though it has more bytes of behavioral code than the GPT-3 weights? Will the Roomba be conscious if I replace its programming with a neural network, even if it behaves the same way? What if I add code to randomly vary its behavior? What if I add code to learn at runtime, considering that the learning code is still perfectly static?

Re:New research suggests our brains use quantum computation by jqpabc123 on Thursday October 20, 2022 @12:26PM (#33277062)
I am indeed a meat robot.

You have my sympathy.

Re:New research suggests our brains use quantum computation by mannykannot on Thursday October 20, 2022 @09:33AM (#33274465)
> all the things that inanimate objects lack and will/have never aquired.

Ah, the standard question-begging ontology backed by nothing more than arguments from incredulity.

Re:New research suggests our brains use quantum computation by grantcas on Thursday October 20, 2022 @02:45PM (#33278922)
It's becoming clear that with all the brain and consciousness theories out there, the proof will be in the pudding. By this I mean, can any particular theory be used to create a human adult level conscious machine. My bet is on the late Gerald Edelman's Extended Theory of Neuronal Group Selection. The lead group in robotics based on this theory is the Neurorobotics Lab at UC at Irvine. Dr. Edelman distinguished between primary consciousness, which came first in evolution, and that humans share with other conscious animals, and higher order consciousness, which came to only humans with the acquisition of language. A machine with primary consciousness will probably have to come first.

What I find special about the TNGS is the Darwin series of automata created at the Neurosciences Institute by Dr. Edelman and his colleagues in the 1990's and 2000's. These machines perform in the real world, not in a restricted simulated world, and display convincing physical behavior indicative of higher psychological functions necessary for consciousness, such as perceptual categorization, memory, and learning. They are based on realistic models of the parts of the biological brain that the theory claims subserve these functions. The extended TNGS allows for the emergence of consciousness based only on further evolutionary development of the brain areas responsible for these functions, in a parsimonious way. No other research I've encountered is anywhere near as convincing.

I post because on almost every video and article about the brain and consciousness that I encounter, the attitude seems to be that we still know next to nothing about how the brain and consciousness work; that there's lots of data but no unifying theory. I believe the extended TNGS is that theory. My motivation is to keep that theory in front of the public. And obviously, I consider it the route to a truly conscious machine, primary and higher-order.

My advice to people who want to create a conscious machine is to seriously ground themselves in the extended TNGS and the Darwin automata first, and proceed from there, by applying to Jeff Krichmar's lab at UC Irvine, possibly. Dr. Edelman's roadmap to a conscious machine is at https://arxiv.org/abs/2105.10461

Re:New research suggests our brains use quantum computation by FeepingCreature on Thursday October 20, 2022 @08:23AM (#33273564)
What's consciousness have to do with impact on reality?
Re:New research suggests our brains use quantum computation by jqpabc123 on Thursday October 20, 2022 @08:49AM (#33273855)
It's just one of the things that inanimate objects can't do --- they can't alter their surroundings --- certainly not "consciously".
Re:New research suggests our brains use quantum computation by ben_w on Thursday October 20, 2022 @09:06AM (#33274083)
Two problems there:

(1) "Animate vs. inanimate" is a separate axis to «every defining feature you've just used for consciousness» vs. «the absence of that»

(2) Inanimate AI can trivially alter their surroundings, all I have to do is say "Alexa, Badezimmer zehn Prozent". And this isn't an AI that I hold in high regard or consider to be conscious or anything like that — I have to ask three times while getting increasingly annoyed, because for some reason Alexa can't hear me properly and the first response is usually "Ich kann nicht Badezimmer auf Spotify finden" even though we don't have Spotify.

Still alters it's surroundings, though.

Re:New research suggests our brains use quantum computation by FeepingCreature on Thursday October 20, 2022 @09:24AM (#33274327)
Inanimate objects can certainly alter their surroundings, or life could never have arisen.
Re:New research suggests our brains use quantum computation by jqpabc123 on Thursday October 20, 2022 @10:08AM (#33274897)
Are you sure they did this all by themselves --- no external forces or quantum physics involved?
Re:New research suggests our brains use quantum computation by ben_w on Thursday October 20, 2022 @10:55AM (#33275686)
Why are those suddenly important? Silicon computers involve both, even when un-networked and alone in a cupboard.
Re:New research suggests our brains use quantum computation by jqpabc123 on Thursday October 20, 2022 @11:28AM (#33276219)
A lightening strike nearby once caused by DVD player to turn on. Does that make it "conscious"?
Re:New research suggests our brains use quantum computation by ben_w on Thursday October 20, 2022 @11:48AM (#33276488)
According to your definition:

> It's just one of the things that inanimate objects can't do --- they can't alter their surroundings

And given that you wrote that as a response to the question:

> What's consciousness have to do with impact on reality?

Then you must logically say that it is.

Fortunately I don't have to claim such a belief for myself, because I said earlier:

> nobody really knows what "consciousness" means (or if they are completely certain, then they also disagree with someone else who is also completely certain and/or deny the logical consequences of that definition).

With specific emphasis on "deny the logical consequences of that definition".

Ah well. Perhaps one day, we'll have an AI that can tell us what consciousness is without repeating all the mistakes and pitfalls that humans make when trying to philosophise about this topic.

Re:New research suggests our brains use quantum computation by jqpabc123 on Thursday October 20, 2022 @12:28PM (#33277084)
The DVD player didn't *do* anything. It was all the result of the lightning strike.
Re:New research suggests our brains use quantum computation by ben_w on Thursday October 20, 2022 @01:28PM (#33277920)
If you wish to make that claim now, then you appear to be mixing your definitions in the middle of your argument.
Re:New research suggests our brains use quantum computation by FeepingCreature on Friday October 21, 2022 @03:42PM (#33292233)
Yes
Re:New research suggests our brains use quantum computation by thfuran on Thursday October 20, 2022 @10:21AM (#33275065)
So the sun is conscious?
Re:New research suggests our brains use quantum computation by jqpabc123 on Thursday October 20, 2022 @10:30AM (#33275233)
No but fire is --- it's always mean and destructive.