If we assume that humans are conscious & material, without bothering to define either, we at least know it is possible to have consciousness embodied in something material. At least in theory we could figure out how human consciousness works and replicate it. There may be easier ways, but this is at least one theoretical possibility.
You could in the same way have inferred that humans could figure out a way of creating flight from the fact that it exists in nature.
Of course, this only applies to intentional creation of consciousness. It says nothing about the distinct possibility that we could create a consciousness by accident.
We can already generate big enough NNs that we can understand them in general (some areas get "specialised" in some way and more active in some conditions), and we know that the result is what we expect - but there's no way someone will take a look at the weights / resulting model and tell you what it does. I think we can create consciousness intentionally, but not understanding the process completely.
Selectively breeding cows for increased milk production allows evolution to find a way or ways of making that happen. The breeder doesn't need to worry about hormones or glands. Evolution doesn't need to worry about the breeder's motives, why are only the high milk producers producing offspring?
Sometimes, when I'm getting overlogical, I see machine intelligence as being pretty much our destiny (i.e. that singularity thing) and that organic life may be very much obsolete once it gets into its own.
As organic life was to the universe before it, machine life will be to us.
ADDED: but yes, extended phenotype and all that jazz.
The design of machines evolves all the time.
It may very well be the case that this is either true or false. We simply don't have enough evidence.
And given the fact that we are discovering new properties of matter and organic reactions all the time, there is a bias towards this being false.
The poster you are responding did not claim that humans are the shit. They merely pointed out the fact that we have so far proven incapable of proving that we aren`t said shit. Now, you could argue that such a hypothesis could only be falsified by the construction of a machine consciousness. That, however, is orthogonal to the fact that it remains possible that there is in fact some bizarre quality of the universe or the human race that makes machine consciousness impossible. Not a terribly scientific position to take, perhaps, but a perfectly sound philosophical one.
No, human intelligence is an emergent quality, and I fathom that even our massive representations of humanity's information (akin to what Google is compiling) will soon begin to exhibit interesting qualities of its own once it becomes complex enough to exhibit perhaps interesting, unanticipated emergent qualities (in fact, if it didn't I would be absolutely shocked). Many strange and unpredictable (or at the very least unanticipated) things arise from even the simplest of "complex systems" (Conway's game of life and some of Wolfram's automata), much less the wonderful systems detailed by our individual neural mappings and our individual genomes. (q.v. http://en.wikipedia.org/wiki/Emergent_behavior)
People always think that some human will "write" an AI like HAL or the like, but it is much more likely that nature will roll its own AI once we have made a comfy enough nest for it to germinate. After all, isn't that how we got here? (from an evolutionary biologists standpoint anyhow...)
And again, sorry for being contentious. I just despise the "religious" argument (even if there is no "named religion" being expounded... Let's keep Ockham's Razor at the ready here....)
From the biological point of view, the simplest species is AS SUCCESSFUL as the most complex species, since both are still alive and procreating.
Why do humans have eternal significance? To whom?
Known to who? I don't like this very self-referencing way of thinking. Very similar to the discovery of America... people were already in America way before Columbus came and "discovered" it. (although apparently he didn't even realize he hadn't arrived to India)
He/She's allowed to have such an opinion, but this discussion is trying for a particular feel and that isn't contributing helpfully to it.
We're machines. That we may not have made a machine of the same class ourselves is an implementation detail. Maybe a large one, but still not really an argument against making conscious intelligent machines. Biology can do it, sooner or later so can we.
Perhaps the disagreement is about when do machines (keeping in mind they're mechanical by definition) cross over to becoming more and more like biological entities (replication). And once they do, is it still coherent to think of them as machines as we use the term today. Or would we then think machines have been elevated to the biological level.
The human has a hideous complicated algorithm in there, involving a live-long history, internal feedback and reflection and arbitrary side constraints.
A spider for example is much simpler. 'If the net shakes, walk where it shakes and eat.' (Certainly, + a batch of regulations to be able to walk and sense, but the point stands).
However, imo at a certain point, a computer program passes the complexity of, say, a spider. Just consider modern compilers. These things are of baffling complexity and do things inside no human can imagine in details :) Or, imagine data mining software, or even just very complicated, security aware network guards. All of these softwares are very, very complicated in their input-output-behaviour, and even though they are not as complicated as a human, they certainly can compete with a spider, at least for me.
And exactly this view is what caused some pretty nasty discussions for me, since some people are just not crossing the line of 'everything is an input-output device of different forms' and they stand hard on the ground that machines and animals are different, because they are machines and animals (and some go ridiculous ways, 'god made animals, humans made machines', and whatsoever, not even some 'but the spider might be more complicated than FOO, because, which whould be a nice discussion :) ).
So, overall, I, as a person who is working hard on being a tolerant, non-racist person (which is really hard), don't see a reason to exclude the possibility of machines and robots being conscious, just because 'they are electrical and not organic' (which has a ring of "he is black, he CANNOT do science" to me. Sorry if I just offended a lot of people).
"Consciousness is not computable" just means we need to build a new class of machine. Whether it's a blob of organic jelly in a box, or an IC with currently unknown structures on it to exploit certain handwavy quantum processes, or whatever; it just makes the task more complex, it doesn't make it impossible.
It may very well be the case that this is either true or false. We simply don't have enough evidence.
It's true, we can't prove it one way or the other at the moment, but that usually just means that Occam's razor should guide our speculations and assumptions. Since the brain seems like all it's doing is performing some computations, why would we ever assume that its true function is to do something more than that?
And given the fact that we are discovering new properties of matter and organic reactions all the time, there is a bias towards this being false.
There's a good chance that the way the brain achieves its computations is indeed a bit more complex than, for instance, an artificial neural network, absolutely. But that's an implementation detail, and there's certainly no reason to assume that there's no computational model that can account for it - biologists are very close to having full working models of individual neurons already. Further, it's highly likely that the brain does its job in a biologically convenient way, not a logically convenient one, and I'd give good odds that there are a lot of logical simplifications that could be made to end up with a cleaner architecture that performs the exact same tasks.
The only two physical process that we know of that are fundamentally impossible to compute with our computing model are quantum computations and chaotic systems. And for chaotic systems we most certainly can simulate them in a way that the output has all the correct properties as far as we know. It's more that we can't reliably do prediction in such systems due to finite precision.
The simple fact is that computers are already our superiors on many tasks. And those tasks are not simple either.
a) The phenomena of qualia remains unexplained. This has no bearing on making something that can mimic consciousness, but does become significant if one wants the real thing. The last argument on this: http://news.ycombinator.com/item?id=766462
b) QM may be intrinsically linked to consciousness. (see Roger Penrose, _The Emperor's New Mind_) Of course, this a mute point given the QM computing seems to be around the corner.
I discount Penrose's argument because he offers no phenomena that actually require his QM effects to explain and offers no plausible evolutionary path by which human minds could have evolved the mechanisms relying on QM. Do other primates have QM effects in their brains? What do these explain, given that the current models of the brain that we have are capable of explaining everything that we see? (Though we don't yet have the practical capability to simulate an entire complex brain and suitable io.)
P.S. I am an atheist, therefore I do not believe there is anything metaphysical about the human brain. Maybe there is something special about our mushy carbon structure -- doesn't matter. In that case, we'll just build our artificial brain with wetware. Hardware is hardware is hardware (and physics is physics). Eventually we'll get an artificial neural net as complex as our biological one. The real question is software...
I realize it is not a defensible argument to say that the human experience is just to "weird" to be computable- I wish I had a better argument for defending my position...
Nonetheless, I find it hard to understand people, such as yourself, that are probably exposed to this same "weirdness" in their heads as I am and yet are so confident it is merely an illusion created by a sufficiently complicated computation.
I agree, though, Hofstadter and Dennett have done an extraordinary job of devising such an answer. There is lots more work to be done, of course.
But what if the answer to the "weirdness" question is, in fact, that it's just an ill-formed question? What if it's just an illusion, and your brain is tricked into seeing something magical about itself where there is nothing there?
Apart from a mystical explanation, I cannot imagine any satisfying answer to the question (i.e. one that doesn't leave you feeling uneasy like Hofstadter's answer does to most people), which usually means that there's something wrong with what we're asking, not with how we're trying to answer it.
I really don't think the question is ill-formed, though. There is a big explanatory gap. Denying that is simply dishonest. It would be like, if you don't know why a bicycle is easier to balance when it's moving, pretending that there is nothing to explain. "Oh, it's just bicycle parts."
No - it's just normal. I think it would be weirder if it wasn't some kind of computation, if I was a unique spirit out of several tens of billions that appeared from some unknowable place and origin, or whatever else 'i' might be.
Doesn't it seem to be beyond what can be expressed by mere computer algorithms?
I have no reason to think it is - I haven't felt what it's like to be a quicksort or a face recognition algorithm for comparison, but I certainly feel like a heap of evolved feedback loops at times - when I fear the dark in a room I know, when I catch sight of living shapes where there are none, when I feel fight-or-flight at certain caller ID numbers, when I desire things that I also don't want, when I feel judgements of people based on some trivial detail.
Nonetheless, I find it hard to understand people, such as yourself, that are probably exposed to this same "weirdness" in their heads as I am and yet are so confident it is merely an illusion created by a sufficiently complicated computation.
What else could it be? There isn't anywhere else it could reasonably be that we know of. You're either suggesting something unknowable (e.g. magic) or some kind of cruel joke (i.e. like a quine is a program that prints it's own source code, we could be a consciousness that sees the world except for the blind spot around the part that allows us to see how we work - and a cover over where that would be).
I'm not confident that we are 'just' a computation, but I'm fairly confident that I am in accordance with the laws of physics (including any we don't know yet) and that places limits on what's possible with the amount of matter in my head, the energy input and output, the sensory input and output bandwidths, the timescales involved, the known behavioural results of varying localities of brain damage, etc.
Besides, what do you mean illusion? Consciousness is not 'fake'.
From my perspective, being a computer would feel a lot weirder.
I think drastically spoken, feelings are just firing neurons. I don't think there is really anything special about (apart from the degree of complexity of the human body). If a computer has an algorithm that says
if(user hasn't typed anything for 14 days) lonely = true
then it has feelings, too. It might sound absurd, but only because it looks so simple. But imagine an enourmously complex program, and the information "lonely" trickles through it. There might be a routine somewhere
if lonely = true connect_irc_channel(#depression)
and so on and so on. From a certain level of complexity onwards, it won't be so obvious anymore, and we won't be able to prevent feeling that the computer really feels.
The ethical issues will rather be the moment when AI's are clever enough that they can be teached. What will humans teach them? Personally I believe the best protection from abuse will be to get that learning process in the public (as compared to AI's learning from companies or military for specific purposes). So my own long term target are distributed virtual worlds in which AI's improve by getting passed around. A single computer user might still teach them bad stuff, but I hope some sort of selection based on many people watching and exchanging bots will get the best possible results even though completely preventing abuse won't be possible.
Erasing knowledge and memories of such AI would be analog to killing, and it will become problem, because throwing out data is easier, and writing you enemies to DVD after each game of Quake 10 becouse of moral issues will be problematic after some time.
Do you have any proof or any testing that can be done to validate that?
If true machine consciousness is possible, it's a lot further off than we would like to think.
Machines are just an expression of humans' extended phenotypical effects on their environment.
Building a car by hand versus building one with a modern robotic assembly line both yield the same output.
Evolved entities (read: complex entities) are not designed.
One could follow all the steps involved in getting a human from his evolutionary ancestor to his current state by using a pair of magic tweezers to make each mutation in the genome happen at the right time and in the right way. Could you tell the difference based on the result?
(BTW, mutation is random, but evolution is not a random process).
Two example quantitative differences (although, I'm not sure why the specific exclusion of qualitative differences):
1) The human eye, for example, has flaws (that are solved in other similarly evolved eyes) that an engineer laughs at - if you were building a human eye, you wouldn't make the same "mistakes". The deviation from the "better" version is measurable.
2) Evolved entities exist because of procreation. And their only reason for existence is to assist genetic material to replicate. Constructed objects reproduce exactly 0 times and have 0 genetic (or other replicator material).
Therefore, I don't consider designing vs evolving as a good way to separate machines capable of consciousness from machines not capable of consciousness.
Organisms (and by extension, or by reason) are alive because their ancestors have been lucky enough to survive long enough to have offspring.
Note, I'm not arguing that machines cannot be capable of consciousness.
But I am saying that constructed machines are necessarily distinguishable from organisms primarily because they're designed with a goal in mind (unlike organisms - these aren't designed but are the result of the co-operation of genes into higher levels of complexity, team work that has happened to be useful to the survival of the replicating matter - DNA, RNA, or possibly other such material elsewhere in the universe).
I would posit that because of the evolved nature of organisms, there may be flaws in their consciousness (e.g. through chemical imbalance, irrational deduction etc.). It is more likely that machines that are designed for intelligence & consciousness would be gifted (or cursed, depending on your convictions) with perfection, rationality, normalcy, as attributes, or at least their designers would attempt that.
So the the nature of their consciousness would be qualitatively different from that of organisms.
What are those flaws, if you happen to know? I'm curious.
Any engineer would naturally assume that the photocells would point towards the light, with their wires leading backwards towards the brain. He would laugh at any suggestion that the photocells might point away, from the light, with their wires departing on the side nearest the light.
Yet this is exactly what happens in all vertebrate retinas. Each photocell is, in effect, wired in backwards, with its wire sticking out on the side nearest the light. The wire has to travel over the surface of the retina to a point where it dives through a hole in the retina (the so-called "blind spot") to join the optic nerve.
This means that the light, instead of being granted an unrestricted passage to the photocells, has to pass through a forest of connecting wires, presumably suffering at least some attenuation and distortion (actually, probably not much but, still, it is the principle of the thing that would offend any tidy-minded engineer). I don't know the exact explanation for this strange state of affairs. The relevant period of evolution is so long ago.
That said, this isn't, for me, a strong refutation of design. Perhaps the designer's purpose was to create creatures with imperfections such as these, with the higher purpose of communicating something deeper.
Or, is there any way of knowing that we won't some day discover there is a very good reason for this?
An engineer would probably try a different ordering.
From this I think there are two potentially interesting products:
- Evolution by natural selection may be usable as an engine of machine consciousness. Some variant of evolution may be at the core of our own consciousness.
- Evolution by natural selection is a mechanical process that we can "take apart" and understand relatively easily. It also happens to be the engine of the process that created species. Happens to be. Even if the evolution of species had never happened, evolution would still exist in abstract. This put it in very good position to be discovered. Perhaps there are equally powerful concepts waiting to be discovered. Perhaps one of them is at the core of our own creativity. Perhaps one of them can be at the core of machine consciousness.
I define consciousness as having an internal model of the world that includes yourself, as well as your own though processes (at a lower degree of fidelity). This says how you compute things, not what you are computing, so it is orthogonal to Church-Turing.
Whether it is achieved will depend on economic forces. I don't see much economic value in making conscious computers, or things which seem to be down that line. So I expect consciousness will come out of pure research (perhaps within a corporation, like IBM), well after computers have exceeded the raw processing power needed.
Because they will be so different from humans, it will have to demonstrate a significantly higher degree of consciousness than a human needs to in order for most people to be comfortable with the term.