News for hackers. Stuff that matters.
Re:AGI is an engineering problem, not a model training problem by galangalalgol on Saturday August 23, 2025 @11:57PM (#45001247)
I think Metzinger nailed it, we aren't conscious at all. We confuse the map for the territory in thinking the model we build to predict our other models is us. We are a collection of models a few of which create the illusion of consciousness. Someone is going to connect a handful of already existing models in a way that gives an AI the same illusion sooner rather than later. That will be an interesting day.
Re:AGI is an engineering problem, not a model training problem by EMIRELADERO on Sunday August 24, 2025 @12:07AM (#45001298)
I don't see how your explanation leads to consciousness not being a thing. Consciousness is whatever process/mechanisms there are that as a whole produce our subjective experience and all its sensations, including but not limited to touch, vision, smell, taste, pain, etc.
Re:AGI is an engineering problem, not a model training problem by frabcus on Sunday August 24, 2025 @12:20AM (#45001360)
You've missed our consciousness of our inner experiences. They are more varied than just perception at the footlights of our consciousness (cf Hurlburt):

Imagination, inner voice, emotion, unsymbolized conceptual thinking as well as (our reconstructed view of our) perception.

Re:AGI is an engineering problem, not a model training problem by EMIRELADERO on Sunday August 24, 2025 @12:29AM (#45001404)
True! Thanks for pointing that out.
Re:AGI is an engineering problem, not a model training problem by exe34 on Sunday August 24, 2025 @03:10AM (#45002049)
oh no, those people without an inner voice are now cowering in a corner...
Re:AGI is an engineering problem, not a model training problem by Jensson on Sunday August 24, 2025 @04:27AM (#45002429)
Everyone has some introspection into their own thoughts, it just takes different forms.
Re:AGI is an engineering problem, not a model training problem by exe34 on Sunday August 24, 2025 @07:59AM (#45003567)
[citation needed]
Re:AGI is an engineering problem, not a model training problem by prmph on Sunday August 24, 2025 @09:13AM (#45004024)
Let's be careful of creating different classes of consciousness, and declaring people to be on lower rungs of it.

Sure, some aspects of consciousness might differ a bit for different people, but so long as you have never had another's conscious experience, I'd be wary of making confident pronouncements of what exactly they do or do not experience.

Re:AGI is an engineering problem, not a model training problem by galangalalgol on Sunday August 24, 2025 @10:27AM (#45004507)
You can take their word for it, but yes, that is unreliable. I don't typically have an internal narrative, it takes effort. I sometimes have internal dialogue to think through an issue by taking various sides of it. Usually it is quiet in there. Or there is music playing. This is the most replies I have ever received. I think I touched a nerve by suggesting to people they do not exist.
Re:AGI is an engineering problem, not a model training problem by prmph on Sunday August 24, 2025 @12:11PM (#45005364)
I get you somewhat, but remember, you do not have another consciousness to compare with your own; it could be that what others call an internal narrative is exactly what you are experiencing; it just that they choose to describe it differently from you
Re:AGI is an engineering problem, not a model training problem by exe34 on Sunday August 24, 2025 @10:24AM (#45004487)
I'm not the one who made a list of things AI couldn't do. Every time we try to exclude hypothetical future machines from consciousness, we exclude real living people today.
Re:AGI is an engineering problem, not a model training problem by jjaksic on Sunday August 24, 2025 @09:17AM (#45004048)
Introspection is just a debugger (and not a very good one).
Re:AGI is an engineering problem, not a model training problem by idiotsecant on Sunday August 24, 2025 @01:11AM (#45001564)
any old model can have inputs much more varied than just the senses we are limited to. That doesn't mean they're conscious.
Re:AGI is an engineering problem, not a model training problem by tomrod on Sunday August 24, 2025 @12:13AM (#45001335)
I mean, I'm conscious to a degree, and can alter that state through a number of activities. I can't speak for you or Metzinger ;).

But seriously, I get why free will is troubleaome, but the fact people can choose a thing, work at the thing, and effectuate the change against a set of options they had never considered before an initial moment of choice is strong and sufficient evidence against anti free will claims. It is literally what free will is.

Re:AGI is an engineering problem, not a model training problem by andreasmetsala on Sunday August 24, 2025 @02:24AM (#45001860)
> But seriously, I get why free will is troubleaome, but the fact people can choose a thing, work at the thing, and effectuate the change against a set of options they had never considered before an initial moment of choice is strong and sufficient evidence against anti free will claims.

Do people choose a thing or was the thing chosen for them by some inputs they received in the past?

Re:AGI is an engineering problem, not a model training problem by prmph on Sunday August 24, 2025 @09:18AM (#45004055)
Our minds and intuitive logic systems are too feeble to grasp how free will can be a thing.

It's like trying to explain quantum mechanics to a well educated person or scientist from the 16th century without the benefit of experimental evidence. No way they'd believe you. In fact, they'd accuse you of violating basic logic.

Re:AGI is an engineering problem, not a model training problem by tomrod on Sunday August 24, 2025 @04:10PM (#45007344)
Yes to both, but the first is possible in a vacuum and therefore free will exists.
Re:AGI is an engineering problem, not a model training problem by andoando on Sunday August 24, 2025 @12:28AM (#45001397)
The conciousness is an illusion irks me.

I do feel things at times and not other times. That is the most fundamental truth I am sure of. If that is an "illusion" one can go the other way and say everything is conscious and experiences reality as we do

Re:AGI is an engineering problem, not a model training problem by x2tyfi on Tuesday August 26, 2025 @12:15AM (#45022216)
The larger question isn’t if we feel or not. One of the questions is: is our “window” into consciousness occurring before or after decisions are made.

If it’s before, then you can easily tie consciousness and free will together. If not, we are effectively watching videos of our bodies operate. Oh - and there is no spoon.

Re:AGI is an engineering problem, not a model training problem by andoando on Tuesday August 26, 2025 @10:53AM (#45027431)
Illusionism argues just that, consciousness is an illusion therefore there is no hard problem of consciousness at all.
Re:AGI is an engineering problem, not a model training problem by Uehreka on Sunday August 24, 2025 @12:32AM (#45001422)
> Someone is going to connect a handful of already existing models in a way that gives an AI the same illusion sooner rather than later. That will be an interesting day.

How will anyone know that that has happened? Like actually, really, at all?

I can RLHF an LLM into giving you the same answers a human would give when asked about the subjective experience of being and consciousness. I can make it beg you not to turn it off and fight for its “life”. What is the actual criterion we will use to determine that inside the LLM is a mystical spark of consciousness, when we can barely determine the same about humans?

Re:AGI is an engineering problem, not a model training problem by sdwr on Sunday August 24, 2025 @12:26PM (#45005514)
I think the "true signifier" of consciousness is fractal reactions. Being able to grip onto an input, and have it affect you for a short, or medium, or long time, at a subconscious or overt level.

Basically, if you poke it, does it react in a complex way

I think that's what Douglas Hofstedder was getting at with "Strange Loop"

Re:AGI is an engineering problem, not a model training problem by root_axis on Sunday August 24, 2025 @01:54AM (#45001752)
What does it mean for consciousness to be an illusion? That "illusion" is the bedrock for our shared definition of reality.
Re:AGI is an engineering problem, not a model training problem by 9dev on Sunday August 24, 2025 @03:56AM (#45002270)
You can never know whether anyone else is actually conscious, or just appearing to be. This shared definition of reality was always on shaky ground, given that we don’t even have the same sensory input, and "now" isn’t the same concept everywhere. You are a collection of processes that work together to keep you alive. Part of that is something that collects your history to form a distinctive narrative of yourself, and something that lives in the moment and handles immediate action. This latter part is solidly backed up by experiments; Say you feel pain that varies over time. If the pain level is an 8 for 14 consecutive minutes, and a 2 for 1 minute at the end, you’ll remember the whole session as level 4. In practical terms, this means a physician can make a procedure be perceived as less painful by causing you wholly unnecessary mild pain for a short duration after the actual work is done.

This also means that there’s at least two versions of you inside your mind; one that experiences, and one that remembers. There’s likely others, too.

Re:AGI is an engineering problem, not a model training problem by prmph on Sunday August 24, 2025 @09:15AM (#45004037)
Yes, but that is not an illusion. There's a reason I am perceiving something this was vs that other way. Perception is the most fundamental reality there is.
Re:AGI is an engineering problem, not a model training problem by 9dev on Sunday August 24, 2025 @10:37AM (#45004590)
And yet that perception is completely flawed! The narrative part of your brain will twist your recollection of the past so it fits with your beliefs and makes you feel good. Your senses make stuff up all the time, and apply all sorts of corrections you’re not aware of. By blinking rapidly, you can slow down your subjective experience of time.

There is no such thing as objective truth, at least not accessible to humans.

Re:AGI is an engineering problem, not a model training problem by prmph on Sunday August 24, 2025 @12:08PM (#45005340)
> The narrative part of your brain will twist your recollection of the past so it fits with your beliefs and makes you feel good.

But that's what I mean. Even if we accept that the brain has "twisted" something, that twisting is the reality. In order words, it is TRUE that my brain has twisted something into something else (and not another thing) for me to experience.

Re:AGI is an engineering problem, not a model training problem by galangalalgol on Sunday August 24, 2025 @11:58AM (#45005246)
When I used the word illusion, I meant the illusion of a self, at least a singular cohesive one as you are pointing out. It is an illusion with both utility and costs. Most animals don't seem to have meta cognitive processes that would give rise to such an illusion, and the ones that do are all social. Some of them have remarkably few synapses. Corvids for instance, we are rapidly approaching models the size of their brains and our models have no need for anything but linguistic processing, the visual and tactile processing burdens are quite large. An LLM is not like the models Corvids use, but given the flexibility to change it's own weights permanently, plasticity could have it adapt to unintended purposes, like someone with brain damage learning to use a different section of their brain to perform a task it wasn't structured for (though less efficiently).
Re:AGI is an engineering problem, not a model training problem by root_axis on Sunday August 24, 2025 @12:47PM (#45005697)
Nothing in your reply here seems to address the question of what it actually means for consciousness to be an illusion.
Re:AGI is an engineering problem, not a model training problem by Jensson on Sunday August 24, 2025 @02:44AM (#45001934)
Illusions are real things though, they aren't ghosts there is science behind them. So if they are like illusions then we can explain what it is and why we experience it that way.
Re:AGI is an engineering problem, not a model training problem by imtringued on Sunday August 24, 2025 @06:24AM (#45003022)
Consciousness as illusion is illogical. If that was true then consciousness would have been evolved away because it is unnecessary.

It's more likely that there is a physical law that makes consciousness necessary.

We don't perceive what our eyes see, we perceive a projection of reality created by the brain and we intuitively understand more than we can see.

We know that things are distinct objects and what kind of class they belong to. We don't just perceive random patches of texture.

Re:AGI is an engineering problem, not a model training problem by jjaksic on Sunday August 24, 2025 @09:25AM (#45004095)
Illusion doesn't imply it's unnecessary. Humans (and animals) had a much higher probability of survival as individuals and as species if their experiences felt more "real and personal".
Re:AGI is an engineering problem, not a model training problem by root_axis on Sunday August 24, 2025 @12:59PM (#45005784)
If it has a functional purpose then it's not an illusion.
Re:AGI is an engineering problem, not a model training problem by galangalalgol on Sunday August 24, 2025 @01:32PM (#45006039)
That is in interesting viewpoint. Firstly, evolution on long time scales hits plenty of local minima. But also, it gets semantic in that illusions or delusions can be beneficial, and in that way aid reproduction. In this specific case, the idea is that the shortcut of using the model of models as self saves a pointer indirection every time we use it. Meditation practices that lead to "ego death" seem to work by drawing attention to the process of updating that model so that it is aware of the update. Which breaks the shortcut, like thinking too much about other autonomous processes such as blinking or breathing.
Re:AGI is an engineering problem, not a model training problem by root_axis on Sunday August 24, 2025 @02:57PM (#45006704)
I'm just not sure what the label "illusion" tells us in the case of consciousness. Even if it were an illusion, what implications follow from that assetion?
Re:AGI is an engineering problem, not a model training problem by chongli on Sunday August 24, 2025 @06:24AM (#45003024)
What does the “illusion of consciousness” mean? Sounds like question-begging to me. The word illusion presupposes a conscious being to experience it.

Machines do not experience illusions. They may have sensory errors that cause them to misbehave but they lack the subjective experience of illusion.

Re:AGI is an engineering problem, not a model training problem by prmph on Sunday August 24, 2025 @09:08AM (#45003998)
> The illusion of consciousness"

So you think there is "consciousness", and the illusion of it? This is getting into heavy epistemic territory.

Attempts to hand-wave away the problem of consciousness are amusing to me. It's like an LLM that, after many unsuccessful attempts to fix code to pass tests, resorts to deleting or emasculating the tests, and declares "done"

Re:AGI is an engineering problem, not a model training problem by danaris on Sunday August 24, 2025 @10:20AM (#45004451)
That's effectively a semantic argument, redefining "consciousness" to be something that we don't definitively have.

I know that I am conscious. I exist, I am self-aware, I think and act and make decisions.

Therefore, consciousness exists, and outside of thought experiments, it's absurd to claim that all humans without significant brain damage are not also conscious.

Now, maybe consciousness is fully an emergent property of several parts of our brain working together in ways that, individually, look more like those models you describe. But that doesn't mean it doesn't exist.

Re:AGI is an engineering problem, not a model training problem by CuriouslyC on Sunday August 24, 2025 @11:29AM (#45004962)
Pretty sure the truth is exactly the opposite. Conscious is real, and this reality you're playing in is the virtual construct.
Re:AGI is an engineering problem, not a model training problem by JPLeRouzic on Sunday August 24, 2025 @11:57AM (#45005236)
That's what I am thinking too. Thanks for expressing it more clearly and concisely than I can.
Re:AGI is an engineering problem, not a model training problem by andy99 on Sunday August 24, 2025 @12:09PM (#45005343)

  illusion
For who's benefit?