> Despite this long record of failure, AGI must be possible. And that is because of a deep property of the laws of physics, namely the universality of computation.
> [Turing] concluded that a computer program whose repertoire included all the distinctive attributes of the human brain — feelings, free will, consciousness and all — could be written. This astounding claim split the intellectual world into two camps, one insisting that AGI was none the less impossible, and the other that it was imminent. Both were mistaken.
etc etc etc. He literally spends more than 60% of the (very long) essay arguing against your "summary".
Anyway, a real tl;dr is right at the top of the page: "Expecting to create an AGI without first understanding in detail how it works is like expecting skyscrapers to learn to fly if we build them tall enough." and then the last sentence: "it is plausible that just a single idea stands between us and the breakthrough. But it will have to be one of the best ideas ever."
In other words, AGI is provably possible, but the author believes that we're going about it all wrong (behaviorist-inspired neural nets running on training sets, etc.) and need a philosophical (specifically: epistemological) breakthrough to move forward.
Philosophers can not seem to comprehend how a mass of meat can create consciousness and take leaps to try to rule out the mass of meat, regardless of the fact that they all know that when bad things happen to said mass of meat bad things also happen to said consciousness.
The Turing Test could not have been a more wrong direction to define AGI. Looking like something does not make you that thing, and it did not at all address capability, just the appearance of capability.
Insight into intelligence will come slowly, and it will come from examining, categorizing, and eventually understanding the internal workings of the human brain.
> Philosophers can not seem to comprehend how a mass of meat can create consciousness and take leaps to try to rule out the mass of meat, regardless of the fact that they all know that when bad things happen to said mass of meat bad things also happen to said consciousness.
You seem to be referring to dualism, a philosophical idea that is largely discredited among philosophers since the early 1900's. Functionalism, emergentism, materialism, and all other leading serious philosophies of mind that implicate the brain were first formalized and studied by philosophers, not neuroscientists.
> The Turing Test could not have been a more wrong direction to define AGI. Looking like something does not make you that thing, and it did not at all address capability, just the appearance of capability.
And philosophers are among the most vocal critics of the Turing Test. The Turing Test was made by Turing, who was first and foremost a mathematician & logician, not a philosopher of mind.
> Insight into intelligence will come slowly, and it will come from examining, categorizing, and eventually understanding the internal workings of the human brain.
Which, of course, is what modern philosophers of mind do.
Then what did philosophers do? Well they applied the Chinese Room argument to all of conciseness, a blunder even worse than the Turing Test.
Neither can anyone else, so far.
> Insight into intelligence will come slowly, and it will come from examining, categorizing, and eventually understanding the internal workings of the human brain.
Insight -- yes. AI -- not so certain. Here's why: it's plausible that intelligence in the human mind emerges as a consequence of an intractable process. We might not be able to understand that intractable process. But suppose that instead of understanding it, we mimic it: we build a replica of the human brain, and it works! But this is not quite artificial intelligence but a replica of natural intelligence. This is not just a semantic difference: even if this mimicry works we may not be able to direct it in any way. For example, we won't necessarily be able to give this brain replica super-human intelligence, without, say, giving it a mental illness at the same time.
But most AIG researchers don't throw their hands up and say, "Oh damn, it's impossible (intractable), it's magic because we don't understand." Forgive me if I feel this a less-than-useful sentiment.
As far as the possibility of intelligence being intractable, what are the chances of this. Is it likely? If we don't even know what AIG entails, how would we possibly put odds on this? If we don't have the odds, what use is there is thinking about it? Should we stop researching AIG because of the possibility that it might be too much for us to handle?
Neither does the author of the article.
> As far as the possibility of intelligence being intractable, what are the chances of this.
I think the odds are very good. Every known complex system -- the weather, for example, or an ant colony -- is intractable, let alone the human brain.
> Should we stop researching AIG because of the possibility that it might be too much for us to handle?
Intractability doesn't mean it's too much for us to handle. We can simulate intractable processes, and we do it all the time (that's how the weatherman knows if it's going to rain tomorrow), so of course it can be studied. The problem with intractable processes is not that they can't be artificially created, but they can't be artificially controlled (or predicted) beyond very short time frame. So it's very possible we could build an AGI, but won't know how to make it any smarter than us.
Make it as smart as the smartest of us and then it'll figure out how to become smarter on its own. Then ask it to explain to us how we work.
Tongue in cheek but once almost-as-intelligent-as-a-human level is reached the next step is not that far fetched - quantity, multiple times faster than humans learning and we have progression on a different scale. Or we can always try mutating the thing to see what comes out - crude but worked at least once.
But this doesn't necessarily follow. The experience of a mind working at a higher speed will be a slowing down of time -- imagine what you'd do if time slowed down. The machine will not necessarily learn more (we might have a limit of how much we can learn), and will probably experience boredom and frustration (as everything around it will be slow) that might drive it crazy.
tl;dr: AGI is possible, but we're going about it all wrong and won't create it until we philosophically understand it.
No, he doesn't say that. On the contrary he names the principle ('Universality of Computation'; see paragraph 4) which guarantees that computers are capable of true intelligence, since, if programmed correctly, they can simulate the behaviour of any physical object, including human brains.
>there is some divine truth and wisdom that only humans possess.
He also explicitly repudiates supernatural explanations (see para immediately before the one mentioning John Searle).
Why is it so hard to remove our self from that equation? Why should intelligence be a skill only humans acquire? It is not only about machines: There is a constant stream of papers revealing animals are not that dumb as thought either. We survived recognizing we are not the center of the universe, may be we are also not alone on the top of the intelligence pyramid.
Latest edge question "What do you think about machines that think?" provides a good and very broad overview of many aspects. I go with George Church: "What do you care what other machines think?"
http://edge.org/responses/what-do-you-think-about-machines-t...
I personally prefer (although it's certainly less measurable) Ben Goertzel's definition - the ability to achieve complex goals in complex environments. It's still wishy-washy enough for people to write off any given achievement of AI though, I guess.
I think Deutsch's argument is that there is also creativity (and creative reasoning) that is omitted from today's approaches to AI.
How many times do we have to hear these arguments to realize they are just hot air? Either computers are capable of intelligence, or they are not. The answer to that question depends entirely on how you define intelligence. If you define it as the set of things humans are capable of and computers are not, then the answer will always be no. But just like humans, computers learn and are taught new things every day, and as time goes on the set of things human's are uniquely capable of grows smaller and smaller.