News for hackers. Stuff that matters.
Re:There's No Fire Alarm for Artificial General Intelligence by nurettin on Saturday October 14, 2017 @04:06AM (#15471241)
Why AGI and not "Artificial Consciousness" ? Is it because people think that consciousness is a by-product emerging from many kinds of pattern detection algorithms that suit all cases? (if so, what is the evidence for that?)
Re:There's No Fire Alarm for Artificial General Intelligence by simonh on Saturday October 14, 2017 @04:17AM (#15471284)
A conscious system might be unintelligent, while it’s possible to imagine a highly intelligent system with no consciousness. They’re just different things.

Also pattern detection is often raised in the way you just did, but it’s realy a distraction. Pattern detection just helps recognise things, it’s not inherently related to the ability to reason about things. So you need both, but they are not the same thing either.

Re:There's No Fire Alarm for Artificial General Intelligence by nurettin on Saturday October 14, 2017 @04:52AM (#15471368)
But where does consciousness arise? Is the ability to reason about things independent of this concept?
Re:There's No Fire Alarm for Artificial General Intelligence by pixl97 on Saturday October 14, 2017 @09:13AM (#15472009)
Where consciousness arises is not the interesting question. Why is. Biologically, brain structures spend a lot of effort predicting what state they will be in soon. Essentially they are always trying to predict the future. As minds evolved this ability separated from processing what was going on to what could be going on (dreams in more advanced creatures). The next important concept is self versus not-self. If you can change the world around you via intelligence you'll want to avoid unnecessary energy inefficient feedback loops. Being able to model your actions and their effects is the first step of defining 'you'.
Re:There's No Fire Alarm for Artificial General Intelligence by edanm on Saturday October 14, 2017 @05:29AM (#15471461)
Short answer - we don't know, but probably?

We don't really know what consciousness is or how it happens. We believe that it's possible to be highly intelligent without being conscious. I mean, I really hope that's true, personally, since we would hope to one day make an AGI that will carry out human desires, and we'd hope we weren't making a conscious entity which would be the equivalent of a slave.

Re:There's No Fire Alarm for Artificial General Intelligence by eli_gottlieb on Saturday October 14, 2017 @04:33PM (#15474119)
> But where does consciousness arise? Is the ability to reason about things independent of this concept?

"Who cares?" and "yes".

Re:There's No Fire Alarm for Artificial General Intelligence by johncolanduoni on Saturday October 14, 2017 @04:18AM (#15471285)
Probably because it's best to not use terms that are likely to spark debate just by word choice unless you actually want to have that debate? If you're concerned with AI risk, it doesn't really matter the precise nature of your philosophy of mind as long as it allows artificial devices capable of reasoning with possibly adversarial goals.
Re:There's No Fire Alarm for Artificial General Intelligence by nurettin on Saturday October 14, 2017 @04:55AM (#15471380)
Ah, so the AGI term users are like "ha-ha I chose a vague term, now you can't argue semantics, take that!"
Re:There's No Fire Alarm for Artificial General Intelligence by frooxie on Saturday October 14, 2017 @05:13AM (#15471419)
We understand what intelligence is better than we understand what consciousness is. "Artificial Consciousness" would be the vague term.
Re:There's No Fire Alarm for Artificial General Intelligence by nurettin on Saturday October 14, 2017 @07:47AM (#15471752)
Not sure what you mean. I've seen some hacker news people argue the exact opposite and downvote me for exploring the exact opposite concept, now the opposite happens. I guess this is not the right place to ask or think.
Re:There's No Fire Alarm for Artificial General Intelligence by frooxie on Saturday October 14, 2017 @02:36PM (#15473505)
> Not sure what you mean.

I mean that e.g. if we create a machine that can solve every thinking-related problem that humans can solve, then we can be certain that we have created artificial intelligence. But how are we supposed to ascertain that we have created something conscious, as in a machine with subjective experience? Strictly speaking I can't be certain that _you_ are conscious. (Also, why would we replace "AGI" with "AC", when people are looking to build something intelligent, irrespective of whether it has internal subjective experience?)

> I guess this is not the right place to ask or think.

That has not been my experience.

Re:There's No Fire Alarm for Artificial General Intelligence by nurettin on Wednesday October 18, 2017 @03:24AM (#15497489)
>> I mean that e.g. if we create a machine that can solve every thinking-related problem that humans can solve, then we can be certain that we have created artificial intelligence.

This is the very notion I'd like to challenge. First of all, there is nothing concrete here so I will make up some definitions.

For simplicity's sake, if you define thought as a way of iterating a large knowledge graph (assuming that a graph is not a grossly inefficient way of representing knowledge), and forming new knowledge (or making inferences) as a way of extending that graph through certain constraints (maybe axiomatic, maybe probabilistic) that somehow also exist within that graph, what goal would a graph have other than the ones you give to it? This would make AGI just an interactive machine.

And if you can't give it adequate goals that will at least make it pass a turing test, what good is a graph that can be used for emergent inferences? My real gripe with that is "It" isn't intelligent. "You" are intelligent and "you" gave it goals. So subjectivity is, in my opinion inescapable when you are talking about intelligence.

I will concede that you can't know I have subjective experiences, but practically that's not a very useful thing to say. If it doesn't matter, why bring it up? If it does matter, why not use your past experience to have a belief that I am conscious despite that belief being subject to future modification? That's how I'd treat a perceived AC.

Re:There's No Fire Alarm for Artificial General Intelligence by johncolanduoni on Saturday October 14, 2017 @06:57AM (#15471640)
Since when is avoiding arguing semantics a bad thing?
Re:There's No Fire Alarm for Artificial General Intelligence by nurettin on Wednesday October 18, 2017 @03:31AM (#15497520)
Since Wittgenstein, Umberto Eco, Roland Barthes? How will you improve your knowledge and understanding of concepts if you don't argue in order to find out the best way of expressing them? Common sense is not a substitute for knowledge. Blanket statements and short dismissals are not a way of furthering our understanding of inference engines and whether subjective experience is required for intelligence and how to quantify that subjective experience.
Re:There's No Fire Alarm for Artificial General Intelligence by johncolanduoni on Wednesday October 18, 2017 @09:19AM (#15498870)
If we had to preface every inquiry with a philosophical debate on everything semi-related to the subject at hand we’d get nowhere (including within philosophy itself). Should all math papers include a section where they argue about why one should use ZFC vs IZF or type theory because that decision might have impact on the matter at hand?

Blanket statements and short dismissals are great when their content is “that’s an interesting topic but not necessarily what everyone is trying to discuss right now.” Discussions on AI risk may not be augmented by understanding of subjective experience, or may require developments that cannot be acquired via even another 100 years of navel gazing on the subject. You’ve not even attempted to justify why this would be the case, and instead started complaining right off the bat that nobody had the inclination to immediately discuss your favorite tie-in to the subject immediately.

You’ll notice that people were actually happy to talk about consciousness once you brought it up, and probably would have been even happier to do so if you didn’t start off with such a curmudgeonly tone and spend a bunch of time accusing everyone of intellectual dishonesty because their interests differ from yours.

Re:There's No Fire Alarm for Artificial General Intelligence by nurettin on Wednesday October 18, 2017 @12:40PM (#15500600)
Well, I've explained in an above comment why I think consciousness is directly proportional to intelligence, and I was pretty content with the conversation so far, actually.

I'm happy that you feel you are so progressive in multiple disciplines and an expert on online behavior. If you think what I said is off-topic, that's just your opinion, man.

Re:There's No Fire Alarm for Artificial General Intelligence by PhasmaFelis on Saturday October 14, 2017 @04:27AM (#15471308)
I don't have any way to prove that you're conscious. It seems premature to assume that a hypothetical future AGI will necessarily possess consciousness, even if we could agree on what exactly "consciousness" is.
Re:There's No Fire Alarm for Artificial General Intelligence by pizza on Saturday October 14, 2017 @04:42AM (#15471352)
OK but here's a little gedankenexperiment: suppose I had a machine that could simultaneously simulate 2 consciousnesses (either parent/child configuration or sibling), (bear with me) import recordings from conscious beings, and allowed one consciousness to query the other. Then it could know if someone were conscious or not.

(if I am getting this right) those would be the minimal criteria for being able to (contentiously) prove if a person were conscious or not.

But the thing about humans is that they cannot simulate 2 consciousnesses simultaneously (apart from culturally-designated illness known as multiple personality disorder), nor can we import another's consciousness. Nor do we even particularly (barring Totoni's work, or Tegmark's work] know what consciousness is. Those two properties are (probably) never going to be human-capable. In that regard, humans are unlikely to be able to ever be a (or 'the') kind of being used to determine whether or not something is conscious; if ever it will be possible, that will be a machine's task.

Re:There's No Fire Alarm for Artificial General Intelligence by leakydropout on Saturday October 14, 2017 @08:01AM (#15471790)
"What is it like to be a bat?" is a paper by American philosopher Thomas Nagel, first published in The Philosophical Review in October 1974, and later in Nagel's Mortal Questions (1979). In it, Nagel argues that materialist theories of mind omit the essential component of consciousness, namely that there is something that it is (or feels) like to be a particular, conscious thing. He argued that an organism had conscious mental states, "if and only if there is something that it is like to be that organism—something it is like for the organism."

Dennett denies Nagel's claim that the bat's consciousness is inaccessible, contending that any "interesting or theoretically important" features of a bat's consciousness would be amenable to third-person observation. For instance, it is clear that bats cannot detect objects more than a few meters away because echolocation has a limited range. He holds that any similar aspects of its experiences could be gleaned by further scientific experiments. -- https://en.wikipedia.org/wiki/What_Is_it_Like_to_Be_a_Bat%3F

Heterophenomenology ("phenomenology of another, not oneself") is a term coined by Daniel Dennett to describe an explicitly third-person, scientific approach to the study of consciousness and other mental phenomena. It consists of applying the scientific method with an anthropological bent, combining the subject's self-reports with all other available evidence to determine their mental state. The goal is to discover how the subject sees the world him- or herself, without taking the accuracy of the subject's view for granted. -- https://en.wikipedia.org/wiki/Heterophenomenology

Re:There's No Fire Alarm for Artificial General Intelligence by yorwba on Saturday October 14, 2017 @05:15AM (#15471428)
> Then it could know if someone were conscious or not.

How? You say "query", but what would the query look like?

Re:There's No Fire Alarm for Artificial General Intelligence by pizza on Sunday October 15, 2017 @12:09AM (#15475845)
subsumption followed by introspection
Re:There's No Fire Alarm for Artificial General Intelligence by leakydropout on Saturday October 14, 2017 @05:15AM (#15471425)
Epiphenomenalism is a mind–body philosophy marked by the belief that basic physical events (sense organs, neural impulses, and muscle contractions) are causal with respect to mental events (thought, consciousness, and cognition). Mental events are viewed as completely dependent on physical functions and, as such, have no independent existence or causal efficacy; it is a mere appearance.

[...]

In 1870, Huxley conducted a case study on a French soldier who had sustained a shot in the Franco-Prussian War that fractured his left parietal bone. Every few weeks the soldier would enter a trance-like state, smoking, dressing himself, and aiming his cane like a rifle all while being insensitive to pins, electric shocks, odorous substances, vinegar, noise, and certain light conditions. Huxley used this study to show that consciousness was not necessary to execute these purposeful actions, justifying the assumption that humans are insensible machines. Huxley’s mechanistic attitude towards the body convinced him that the brain alone causes behavior.

[...]

A large body of neurophysiological data seems to support epiphenomenalism. Some of the oldest such data is the Bereitschaftspotential or "readiness potential" in which electrical activity related to voluntary actions can be recorded up to two seconds before the subject is aware of making a decision to perform the action. More recently Benjamin Libet et al. (1979) have shown that it can take 0.5 seconds before a stimulus becomes part of conscious experience even though subjects can respond to the stimulus in reaction time tests within 200 milliseconds. -- https://en.wikipedia.org/wiki/Epiphenomenalism

Re:There's No Fire Alarm for Artificial General Intelligence by sullyj3 on Sunday October 15, 2017 @02:48AM (#15476178)
Because when I'm worried about a machine recycling the atoms that make up my body, I'm not particularly interested in whether it has conscious experience. There's no particular reason to suppose that something needs to be conscious in order to be very effective at achieving arbitrary goals.
Re:There's No Fire Alarm for Artificial General Intelligence by MaxfordAndSons on Saturday October 14, 2017 @04:17AM (#15471283)
No, if anything it's the opposite. Too many people who are irrevocably hung up on the "hard problem of consciousness" would object to the language.
Re:There's No Fire Alarm for Artificial General Intelligence by tedivm on Saturday October 14, 2017 @04:16AM (#15471280)
I think it's just because intelligence is better defined and easier to test than consciousness.
Re:There's No Fire Alarm for Artificial General Intelligence by akvadrako on Saturday October 14, 2017 @05:19AM (#15471431)
Intelligence is one of the most poorly defined words there is; I can't even begin to imagine what you have in mind.

Consciousness is usually only one of two things; either "being aware" or "the experience of having an inner voice".

Re:There's No Fire Alarm for Artificial General Intelligence by Smaug123 on Saturday October 14, 2017 @07:30AM (#15471717)
Neither of those is a concrete definition. Defining "consciousness" as "being aware" is just punting the question on to "how do you define the word AWARE?".

And some people don't have an inner monologue. It's not specifically mentioned in http://slatestarcodex.com/2014/03/17/what-universal-human-ex... but it's of that same class of thing; there are certainly hits on Google for people claiming not to have an inner voice, and I didn't even bother reading the article on psychologytoday about it.

Re:There's No Fire Alarm for Artificial General Intelligence by akvadrako on Sunday October 15, 2017 @04:22AM (#15476355)
"Being aware" is a common phrase understood by most native english speakers as a synonym of "conscious". If you are asleep, you are not aware of much. If you get hit by a car as you cross the road it's probably because you weren't aware of it. You can do some actions, like driving, either consciously or unconsciously.

I didn't say that all "people" have inner voices (by which I meant inner life). But by that definition, it's a requirement to be conscious.

Re:There's No Fire Alarm for Artificial General Intelligence by Filligree on Saturday October 14, 2017 @08:51AM (#15471927)
Yup, I'm one of them.

Let me set the record straight, though. I'm not claiming to not have an inner life; I'm claiming to not have an inner voice, except if I'm reading "out loud" internally or whatnot. (Which is useful when writing, but not necessary.)

I just use other modalities.

To the best of my knowledge there's only one guy, a philosopher, who's claimed to have no inner life at all--and I don't think I believe him.