News for hackers. Stuff that matters.
Re:Why This AI Moment May Be the Real Deal by strikelaserclaw on Tuesday August 01, 2023 @10:14AM (#36956200)
Although i fundamentally agree with you, i will say that it is impossible to know which "tricks" will lead to a leap in cognition, even looking evolutionarily, the difference in genome between a monkey and human is very small percentage wise, yet the effects of that small difference are stark.
Re:Why This AI Moment May Be the Real Deal by unshavedyak on Tuesday August 01, 2023 @10:31AM (#36956406)
I'm always on the position that at some point (i make no prediction of when) "AI" will still be labeled as not-intelligent, but to external observers it won't be possible to know.

Ie we will be able to describe how a function of `add(1,2)` is most clearly definitely not intelligent. We will understand the internal makeup of these neurons better, the whole system will be deterministic and understood - just a very large `add(1,2)` .. so it's definitely not intelligent, of course.

Yet it will still produce output that is fully and truly turing-proof. If you let it run, it retains, stores, "behaves", etc. It's clearly just `add(1,2)` in a loop after all.. we will understand it so well that it's obviously just a trick of our mind that it seems real.

The conclusion in that space will not be one of the machine .. but of us. If we can't tell it apart from us.. and if we know it is most definitely not alive or even mysterious.. what does that say about us? The existential crisis will be neat.

Re:Why This AI Moment May Be the Real Deal by c_crank on Tuesday August 01, 2023 @10:36AM (#36956468)
>If we can't tell it apart from us.. and if we know it is most definitely not alive or even mysterious.. what does that say about us?

Less than people think. We know that being a biological system differentiates us. If intelligent systems tend to converge where language is concerned, so be it. It doesn't mean the AI warrants any special consideration. It's still a tool.

Re:Why This AI Moment May Be the Real Deal by mercurialsolo on Tuesday August 01, 2023 @10:54AM (#36956741)
While life is typically associated with biological systems, intelligence doesn't necessarily need proof of life. A hive, swarm or network can be intelligent as long as it shows self-awareness and has agency.
Re:Why This AI Moment May Be the Real Deal by c_crank on Tuesday August 01, 2023 @10:56AM (#36956789)
I'm not disputing that. I just think that intelligence or 'sapience' is not something that requires reverence on our part.
Re:Why This AI Moment May Be the Real Deal by TeMPOraL on Tuesday August 01, 2023 @12:38PM (#36958434)
What is then, if anything? Definitely not "being a biological system" - that seems much more boring than intelligence, and the line between "biological" and "non-biological" is somewhat arbitrary and increasingly blurry anyway.
Re:Why This AI Moment May Be the Real Deal by c_crank on Tuesday August 01, 2023 @12:40PM (#36958467)
It is a quality that makes something good at drawing pictures and writing smart sound replies to prompts. And translating.
Re:Why This AI Moment May Be the Real Deal by jacobr1 on Tuesday August 01, 2023 @04:34PM (#36962378)
I'm increasingly thinking the game-theoretic emergent properties of social interaction as described in papers like https://desirism.com/morality-from-the-ground-up provides a good basis for thinking about this. The distinguishing factor then becomes something like, the agent is is participant in the moral-sphere by having "enough" properties to do so. It still leaves the details of that gradient a bit undefined, but at least specifies the basis upon which to make a judgment.
Re:Why This AI Moment May Be the Real Deal by tshaddox on Tuesday August 01, 2023 @12:13PM (#36958022)
> If we can't tell it apart from us.. and if we know it is most definitely not alive or even mysterious.. what does that say about us?

That concepts like "consciousness," "free will," and "qualia" are nebulous precisely because they were invented by us to describe things we don't understand yet we feel obligated to insist are special and unique characteristics of our identity.

Re:Why This AI Moment May Be the Real Deal by TaupeRanger on Tuesday August 01, 2023 @12:41PM (#36958476)
They aren't nebulous. "Consciousness" means "an existing stream of experiences". "Free will" means "a feeling that one could've made a different choice" (the metaphysical status of the claim still unknown), and "qualia" means "specific characteristics of experiences that one can attend to". One need not "insist" on anything to believe they are unique characteristics of our identity.
Re:Why This AI Moment May Be the Real Deal by vidarh on Tuesday August 01, 2023 @01:11PM (#36958975)
None of your definitions are less nebulous than the terms you defined.
Re:Why This AI Moment May Be the Real Deal by TaupeRanger on Tuesday August 01, 2023 @03:17PM (#36961099)
Yes they are - they are AS non-nebulous as you can possibly get - totally black and white obvious. "Is there a stream of experiences?" is very straightforward, black and white. It's what you have when you're awake, and what you lose when you're in dreamless sleep. Not nebulous in any way.

"Can you pay attention to this part of your experience?" is a very black-and-white, non-nebulous question with an easy yes or no answer. Not sure what you're reading into this.

Re:Why This AI Moment May Be the Real Deal by jacobr1 on Tuesday August 01, 2023 @04:17PM (#36962114)
No, it is unclear because this definition insufficiently distinguishes a cluster of related, and ill-defined concepts.

Consider a video camera. It seems like it is a consuming a "stream of experiences". But most people wouldn't consider it it conscious. Why not under your definition? It works when on, and is stops when turned off. Black and white. But clearly we are missing some nuance in the details. Maybe we also require some interpretation of the experiences? I can spin a convolutional neural net that identify objects within a video: interpretation. Does that make it conscious? No? Then we need something else to define it. Maybe response to stimuli? We can program machines for that, but then also things like fire respond to environment interactions too. And so on. It really isn't black and white after all.

Re:Why This AI Moment May Be the Real Deal by vidarh on Tuesday August 01, 2023 @05:34PM (#36963375)
What is an experience?

What does "pay attention" mean?

Re:Why This AI Moment May Be the Real Deal by ChainOfFools on Tuesday August 01, 2023 @11:52PM (#36966755)
Dualism, or at any rate the version of it that can be described as operating on the (possibly unconscious) assumption that a world "outside" of this world exists, is the secret ingredient at work here, smuggled in along with the kinds of notions expressed by the person you're replying to. We just can't seem to fully disentangle very old deep-seated animist instincts, even sophisticated formulations of them, like the soul or consciousness, from our reasoning and descriptions of dynamic systems. I'm not sure this is a bad thing even though I recognize that it is a crutch. completely materialist interpretation of phenomena would probably lead us to the realization that we are not alive at all, and that what I call "my life" is just a kind of curling strand of causality frozen in the Parmenides block universe.

I've come to suspect that a habit of using the passive voice when discussing these phenomna contributes immensely to their ongoing currency. Steering away from this by asking questions like, "_who_ or _what_ is attending to/experiencing the stream?" may be a useful way to ground these statements in material terms.

Re:Why This AI Moment May Be the Real Deal by vidarh on Wednesday August 02, 2023 @06:21AM (#36969009)
I see dualism vs. consciousness as separate. Dualism is often used as an explanation for how (real, not compatibilist) free will can exist in an otherwise materialist world, but it'd still require the "outside" to be "magic" in the sense that it'd require a class of logic that is neither deterministic, nor random, nor just any form of combination of the two (e.g. not stochastic).

Consciousness, on the other hand, boils down to what gives rise to the sensation of self-awareness, and what that sensation actually is, and it's not a given that requires any form of dualism (or that any form of dualism would solve the question at all) or that a strict materialist world can't involve self awareness.

For what we know, self-awareness could be a property of matter itself, and the only thing different between "conscious" and "non-conscious" is getting to a level of sufficient reasoning-ability to actually be able to express it.

Re:Why This AI Moment May Be the Real Deal by TaupeRanger on Wednesday August 02, 2023 @08:06AM (#36969718)
You're having experiences right now. It's that. You're paying attention to these words. It's that.
Re:Why This AI Moment May Be the Real Deal by pixl97 on Wednesday August 02, 2023 @08:17AM (#36969831)
You keep saying stream of experience, but you don't actually have a stream in the sense of a continuous uninterrupted experience. Your mind let's you believe that though.
Re:Why This AI Moment May Be the Real Deal by vidarh on Wednesday August 02, 2023 @08:47AM (#36970151)
That's a good point. We appear to have no way (and probably can't have) to discern passage of time from a static experience of a single infinitesimally short moment, as our only experience of time is through memory that we can't know whether is a static snapshot or dynamic.
Re:Why This AI Moment May Be the Real Deal by TaupeRanger on Wednesday August 02, 2023 @12:08PM (#36972825)
Since we don't understand its nature, we actually have no idea whatsoever whether it's a continuous stream or not. I mean obviously we sleep, but I take it you didn't mean that kind of interruption, which is beside the point. But either way, it doesn't matter, because "stream" can simply mean "the quick succession of experiences that seem to be continuous to the experiencer". And none of this really matters at all for the discussion at hand, the answer is the same either way.
Re:Why This AI Moment May Be the Real Deal by pixl97 on Wednesday August 02, 2023 @02:29PM (#36974918)
Consciousness is not a continuous stream at all, the fact you fall asleep or can be given medication to turn it off is an obvious example.

Nova/PBS recently did a number of episodes on the number of tricks your brain is playing on your at anytime. Once you start seeing the shortcuts the brain takes in action the entire process is far less magical.

Re:Why This AI Moment May Be the Real Deal by vidarh on Wednesday August 02, 2023 @08:43AM (#36970111)
And which measurable, enumerable qualities of those things set them apart from not having experiences or not paying attention so that I can determine whether or not an AI, or a camera, or an animal, or another human, is "having experiences" or "paying attention"?

Because it's still equally nebulous.

Re:Why This AI Moment May Be the Real Deal by TaupeRanger on Wednesday August 02, 2023 @12:06PM (#36972785)
That wasn't the question - we don't know how to determine whether an AI or camera has it. But it's not nebulous - it's what you're experiencing right now. That's simply what we mean by the word - that's it - no nebulosity to it. Figuring out whether a computer has it is a separate question, and difficult.
Re:Why This AI Moment May Be the Real Deal by dragonwriter on Wednesday August 02, 2023 @12:21PM (#36973020)
> it’s what you’re experiencing right now.

No, its not.

Its the quality of “experiencing”.

Which is impossible to define in objective terms; it is the essence of subjectivity on which all other subjectivity rests. It’s not merely “we don’t know how to determine whether an AI or camera has it”, it is categorically impossible to determine if something has it. The popular narrative about which things in the natural world have it has evolved radically over time, but in no case has there been, or could there be, any empirical basis for this; its all just vibes.

Re:Why This AI Moment May Be the Real Deal by vidarh on Thursday August 03, 2023 @01:05AM (#36981603)
It became the question when you tried to define the original terms that way, because a definition that can not be used to discriminate what it defines from what ot does not define is inherently nebulous.

And your definition is now circular and can not be used that way.

Hence the claim that the original definitions were nebulous.

Re:Why This AI Moment May Be the Real Deal by tshaddox on Tuesday August 01, 2023 @02:51PM (#36960641)
> "Consciousness" means "an existing stream of experiences".

Those seem equally nebulous.

> "Free will" means "a feeling that one could've made a different choice"

That doesn't seem like the ordinary definition of the term, either in philosophy or in everyday usage. I would think most people would define "having free will" as not just feeling that one could have made a different choice, but rather it actually being physically possible for a different choice to have been made.

> "qualia" means "specific characteristics of experiences that one can attend to"

I think those are also equally nebulous.

> One need not "insist" on anything to believe they are unique characteristics of our identity.

The insistence is necessary, and invariably comes up. As soon as I say to someone "given your definitions of these concepts, I don't think they exist" they will say "well, I've started with the foregone conclusion that I cannot deny the existence of these things, so either you're plainly wrong, or we need to tweak our definitions and understanding of these things."

Re:Why This AI Moment May Be the Real Deal by TaupeRanger on Tuesday August 01, 2023 @03:19PM (#36961133)
> Those seem equally nebulous.

They aren't. It's literally happening right now as you read this - a stream of experiences is present. If that is the case, YES it is consciousness, if nothing is happening, NO it is not consciousness. Black and white - literally as non-nebulous as you can get.

Re:Why This AI Moment May Be the Real Deal by OkayPhysicist on Tuesday August 01, 2023 @02:31PM (#36960307)
Eh, that's not super concerning to me. It falls into the same pitfall as "chemical reactions aren't conscious, our brains are just lots of chemical reactions". Namely, it's the mereological fallacy: a denial of emergent properties. A single water molecule is not a liquid, a gas, or a solid. The property "phase of matter" simply does not exist until you have at least a handful of molecules.
Re:Why This AI Moment May Be the Real Deal by unshavedyak on Tuesday August 01, 2023 @02:42PM (#36960471)
Oh, i agree. If anything i'm apathetic to us being unique at all. However i'm speaking in the general cultural perception sense. I think a lot of humanity depends.. or at least has built a self-image around uniqueness as a foundation to our believed superiority.

We often discuss things that would challenge or overtake us. Hypothetical advanced aliens, artificial AI, etc. However i don't often see pop culture discussing the opposite - us, or even life, being challenged on it's uniqueness. Plus then that leads to all sorts of self-autonomy discussions (which is discussed in pop culture imo).

I dunno, i suspect "people" won't handle it well. Hell, there's entire religion(s) built on the foundation that we're uniquely gifted as a product of being crafted in a gods image. To question us could question god. I find these questions neat, interesting, etc - but socially i suspect it would be troubling, contentious, frightening.

Re:Why This AI Moment May Be the Real Deal by OkayPhysicist on Tuesday August 01, 2023 @02:59PM (#36960786)
We've dealt with this problem before: Historically all humans being "people" is a relatively new concept in of itself. I'm sure there's going to be growing pains there, but I think we'd figure out how to cope. Hopefully relatively quickly compared to that example.