News for hackers. Stuff that matters.
Re:IBM's "Watson" finally ready for prime-time Jeopardy by JoeAltmaier on Thursday February 10, 2011 @11:02AM (#2202314)
Watson is a simulation, a clever puppet designed to mimic human behavior. We have no more to fear from it, than from a punch and judy show.

Cleverer and cleverer puppets will not become intelligent machines. A dedicated effort to build a massive neural cluster simulation might become intelligent, but it will think such incomprehensible thoughts as to be fairly useless to us (think intelligent rhododendon; what would you have to talk about?)

We will know when Watson is dangerous when it feels fear, angst, want. Not just an algorithm to sort facts and simulate speech.

Re:IBM's "Watson" finally ready for prime-time Jeopardy by cryptoz on Thursday February 10, 2011 @11:10AM (#2202345)
Watson is not a simulation any more than your brain is a simulation. Your brain is (likely) mostly just algorithms and data structures, albeit on an enormous scale. This could be wrong, but I'm betting not. What else could the brain possibly be? It's not magic.

> We will know when Watson is dangerous when it feels fear, angst, want. Not just an algorithm to sort facts and simulate speech.

Nah. Look at good science fiction to see why this is false. The most dangerous AI ever conceived might be something like Skynet or HAL 9000; machines that are cold, calculating and have no emotion whatsoever. But they do hold weapons, they do speak English and they are intelligent. I'm not suggesting we'll ever build anything like what we see in science fiction, but good writers often are able to predict - or even influence (see Clark, Asimov) - the future.

Algorithms to sort facts are indeed the beginnings of machine intelligence.

Re:IBM's "Watson" finally ready for prime-time Jeopardy by JoeAltmaier on Thursday February 10, 2011 @11:12AM (#2202352)
I deny that the human brain IS algorithms. It is neurons connected by dendrons/synapses. Right?

Small bits of it can be algorithmically simulated. Large processes can be algorithmically simulated. But to call the algorithm "intelligence" is sympathetic magic.

Algorithms work in a different way; they break in a different way; they are hard-coded so don't change. They are a simulation.

Re:IBM's "Watson" finally ready for prime-time Jeopardy by kls on Thursday February 10, 2011 @11:43AM (#2202511)
No disrespect intended but, I think you are lacking a fundamental understanding of machine learning, genetic algorithms, neural networks and AI in general.

I was introduced to Watson when I took a sub-project from IBM related to Watson, I had no idea what it was untill taking the contract, at which point I was introduced to Watson and it is an impressive feat, it is with out a doubt the state of the art in NLP AI. Sufficient to say, AI algorithms differ from the static and rigged structures that most developers write for business apps, web or mobile apps (even the good developers that decouple stuff), the scale of difference is orders of magnitude.

In many cases machines learning has the ability to generate new code based on learning and build new connections and new algorithms to deal with learned problems. Applications literally generate new and novel applications and then connect themselves to these new nodes.

This is not stuff usually broached when you just need to credit a line in an account payable or get the sales volume for last month. There is a huge gap between the code used to write business applications and the structures used in AI.

This is not meant as a critique of you or anyone in general, and is not intend to belittle business app, mobile or web developers but rather to help inform people that, those who have not worked in the field of AI, that their understanding of software development has little relevance when applied to the field of AI. It is literally a different world where the concepts are totally foreign to a non-AI developer.

Re:IBM's "Watson" finally ready for prime-time Jeopardy by coffeemug on Friday February 11, 2011 @06:46AM (#2205982)
I've only spend a relatively short amount of time studying the subjects you mentioned, so correct me if I'm wrong, but the meta-programming aspects you're mentioning here are either highly exaggerated, or significantly less impressive than you make them sound.

Machine learning is really computational statistics - it applies fairly standard and well understood techniques to fit a function to a noisy data set. Genetic algorithms and neural networks are really fancy words for optimization algorithms - they're merely a set of tools (not unlike hill-climbing) for searching a large space. The de-facto books on AI are PAIP and PPAI. I've read both, and example programs there, while very interesting, are not much different than a combination of reasonably clever techniques.

"Generating new code" is the same thing as generating a data structure and running a predefined interpreter over it. These systems do that, but in a much more restricted way than you imply. They certainly don't design new algorithms in an intelligent fashion, merely use a set of predefined inference rules, not unlike any other rewriting system.

I don't know anything about Watson, but it is a well understood fact that every AI system to date is nothing more than a clever marionette (and it's very unlikely that this will change for a very long time). You can't just throw terms around - show an example. In every case so far a result that initially appears impressive, when understood, is immediately disappointing. They're all clever, but they're a far cry from "self-learning systems" for any reasonable definition of the word "learning".

Re:IBM's "Watson" finally ready for prime-time Jeopardy by kls on Friday February 11, 2011 @10:43AM (#2206663)
but the meta-programming aspects you're mentioning here are either highly exaggerated, or significantly less impressive than you make them sound.

I don't think that I have exaggerated, the fact that currently AI systems are built by developers with a predetermined set of rules in not in dispute, those rules constrain what an AI system will generate this is analogies to the function of serotonin in the brain, it's level directly affects a factor of our state (happiness, empathy). Machine learning employs the same factor, basic here is serotonin (data) and here is the serotonin regulation mechanism (algorithm) but the machine learns (abuse drugs) to defeat the regulation mechanism, none the less it has to work within the constraints of the system, just as our minds have to work with the constrains of their biological functions. It works with in the constraints of the system to find ways to adapt the system. Whether this is impressive or not is subjective to the observer (I personally think it is). When contrasted to a biological level, it is pretty primitive reward logic is pretty low level when it comes to biology. None the less I think it is impressive.

I think when talking about AI a lot of people confuse consciousness with intelligence. While evidence suggest that intelligence is a prerequisite of consciousness the converse cannot be said. I think we have made great strides simulating the constructs of intelligence on a mechanical level. As for consciousness, we have to master the former before we will know how to tackle the latter. And when most people think about AI they think about the latter which sets a pretty high bar when measuring the state of the art.

Re:IBM's "Watson" finally ready for prime-time Jeopardy by Dn_Ab on Friday February 11, 2011 @11:38AM (#2206955)
I agree. Consciousness is not required for intelligence. Before I read your post, I was going to write to mention as well that people's definition is not only extremely wide ranging - running the gamut from memorizing digits of pi or spitting out trivia to self awareness and introspection - but it is also inconsistent. Changing scope and form based on whether the entity in question is autistic or a machine.

I muse that there is a race of AI type intelligences where genius is measure only in their ability to create moving works of arts and any fool can perform advanced mathematics and exceedingly complex computations involving a vast amount of variables.

Re:IBM's "Watson" finally ready for prime-time Jeopardy by Dn_Ab on Friday February 11, 2011 @11:28AM (#2206894)
You make a large mistake here. I feel that the only way your argument holds is by assuming its conclusion. Which would be: what is going on in [some/most] of our brain is something more than or very different from 'just' statistical inference and optimization. Right now, we don't know whether this is true or not but more people are beginning to think not.

For example let us consider that based on time of day and knock you can guess who is most likely at your door. How why, can you know this? Have you learned or figured out anything there?

Or say, I tell you that a person is of gender X, race Y and lives in city Z. You will automatically generate an idea of what this person is like. And it will be different from what I would generate and these data points would likely mean nothing of significance to a 3 year old. Why? Because we have learned a model from our past experience/data. Machine Learning also uses generative models to infer situations. And in fact, we humans perform a very weak form of machine learning. It goes by the name of stereotyping or profiling.

When you are trying to figure out something. The process is not some clean logical step by step deduction. It is more like a search with dead ends (local optimums), back tracking and restarts. Trying and throwing away different ideas. Or when trying to learn a new sport, dance or flip. You do not consider the physics of the situations to try and figure amount the correct amount of impulses to apply. You try again and again to learn or statistically generate a satisfactory approximate local optimum of the correct physics model for the situation at hand.

As for systems which generate code. We can look at it most literally in terms of those which evolve rules in some way or loosely by considering that all machine learning does is use lots of data to prevent the programmer from hand coding a giant restricted system. Regardless of your stance, these systems differ from mere rewriting in that they are not deterministic. They interact and respond to different situations in varying ways. The more sophisticated methods can develop new algorithms - a set of rules - that were not programmed and make no sense to the developer to develop behaviours to cope with their situations. It is true that we provide a base, but that does not mean some limited form of learning is not occurring. What Machine learning cannot do that we can is introspect, abstract and generalize across domains.

I am the reverse of you. Before I picked up machine learning I thought the brain was something special. But now I cant help but feel that we are just clever marionettes and that whats going on is simply mundane mathematics by clever co-opting of physics by nature. I find this fact to be amazingly beautiful.

Re:IBM's "Watson" finally ready for prime-time Jeopardy by arethuza on Thursday February 10, 2011 @12:01PM (#2202614)
I think anyone who has worked in the field of AI would admit there are a lot of philosophical questions around the definition of intelligence and it's relationship to algorithmic problem solving.

One of my favourite thought experiments in the area being Searle's Chinese Room:

http://en.wikipedia.org/wiki/Chinese_room

Re:IBM's "Watson" finally ready for prime-time Jeopardy by kls on Thursday February 10, 2011 @12:15PM (#2202691)
Sure, intelligence is much like religion or faith, what it is is a very personal matter as well a philosophical matter to each observer. To me if a machine can make a logical decision that it arrives at via it's own conclusion independent of human involvement (after the initial construction). It can be said to be intelligent. I personally think we have already achieved intelligent machines. Granted not intelligent in the traditional biological sense but intelligent in their own right. I do believe that we are close to hyper-intelligent machines than many think we are. I personally think it will be the next big step. I also believe that it will fundamentally and irrevocably change humanity. It is a Pandora's box that we will not know the ramifications of until we pass that event horizon, it is much like Schrodinger cat, full of possibilities but until we experience the event we will not know how it affects humanity.
Re:IBM's "Watson" finally ready for prime-time Jeopardy by Qz on Thursday February 10, 2011 @03:46PM (#2203640)
If you read further on Searle and the Chinese Room, you'll find that most of his argument has been debunked and what remains is an Appeal to Common Sense. "The man in the room can't really understand Chinese--right guys?"
Re:IBM's "Watson" finally ready for prime-time Jeopardy by natural219 on Thursday February 10, 2011 @02:31PM (#2203327)
How is this anything but pure semantics? I still don't know the conceptual difference between Searle's strong AI and weak AI, other a single word change in the definition.
Re:IBM's "Watson" finally ready for prime-time Jeopardy by blauwbilgorgel on Thursday February 10, 2011 @03:39PM (#2203616)
It's all about semantics with philosophers ;)

Searle claims through this experiment that strong AI does not exist. The robot in the room doesn't know how to talk Chinese, it just matches up symbols by using an elaborate dictionary.

Turing defined intelligence by the appearance of intelligence. If the Chinese room can make you think it houses someone that speaks Chinese, than that means the person in the room is intelligent.

To Searle everything is weak AI. Just calculation, without knowing what they really calculate. Intelligence is more than appearance, like a hologram of someone, is not that person self.

Pragmatists and functionalists play around Searle's conclusion. For them it is about the behavior, not the system itself. In Searle's vision something like the China Brain (every person in China uses a radio to act as a neuron) is ridiculous. In the functionalist view the China Brain is intelligent and self-aware.

Re:IBM's "Watson" finally ready for prime-time Jeopardy by blauwbilgorgel on Thursday February 10, 2011 @03:25PM (#2203550)
Arguing that consciousness and the brain is different from deterministic algorithms, or neural networks is perfectly valid. It doesn't show lack of understanding of AI. Just that the debater is not an adherer of strong AI functionalism.

Using Gödel's incompleteness theorems one can argue that no set of algorithms is capable of perfectly modeling human consciousness. A logically correct algorithm can not give faulty output, yet internally conclude that output to be correct. We do not make the same mental steps as a set of algorythms: I can't say this post is correct with a 97.77% accuracy. In fact I wonder if you will respect me more or less after this reply, if you'll believe I lack understanding of machine learning... not if I passed the Turing test for intelligence or not. Calculation != Intelligence.

Like the robot in the Chinese room is still a puppet, that doesn't really understand Chinese. Attaching a radar to a flying drone doesn't make it feel or act like a bat.

Much of AI is still Advanced Informatics.

Re:IBM's "Watson" finally ready for prime-time Jeopardy by kls on Thursday February 10, 2011 @04:40PM (#2203901)
I was directly responding to this portion of the parents posts:

Small bits of it can be algorithmically simulated. Large processes can be algorithmically simulated. But to call the algorithm "intelligence" is sympathetic magic.

Algorithms work in a different way; they break in a different way; they are hard-coded so don't change. They are a simulation.

By the structuring of his description, it is apparent that he is reasoning from an application or "computer" if you will, developers perspective. My point was that it is flawed to look at AI software as rigid structures, applying traditional development patterns is flawed and does not reflect the realities of AI development. Put simply the description of AI as hard-coded paths and developer generated (implied) algorithms is in no way factual.

Re:IBM's "Watson" finally ready for prime-time Jeopardy by blauwbilgorgel on Thursday February 10, 2011 @05:29PM (#2204125)
I agree with you on that. AI has advanced beyond rigid structures and scripts. Using a system that operates with fuzzy logic or building a neural network and teaching it, 'till you the programmer can't make heads or tails of its computations and derivations is a wonderful thing indeed.

As an aside: like Penrose chose quantum physics (a mysterious thing) to explain consciousness (another mysterious thing), and therefor didn't succeed to convince others, so we should guard against using a fuzzy, complex, black-box, dynamic system (a mysterious thing) to explain (or fully model) consciousness and human intelligence.

We just replaced the wonder with another wonder :)

Re:IBM's "Watson" finally ready for prime-time Jeopardy by Dn_Ab on Thursday February 10, 2011 @06:20PM (#2204304)
How is Godel's incompleteness theorems an issue here? AI does not have to model the human brain by simulating it. And it need not be rigorously/axiomatically defined as a decidable formal system nor does it need the ability to prove its own consistency. Nor does it need to be consistent, making the GITs inapplicable. Heck the AI could use paraconsistent logical reasoning or couple bayesian inference with a suitable multi-valued logic as its base.
Re:IBM's "Watson" finally ready for prime-time Jeopardy by mquander on Thursday February 10, 2011 @11:59AM (#2202604)
"I deny that the human brain IS algorithms. It is neurons connected by dendrons/synapses. Right?"

"I deny that Watson IS algorithms. It is transistors assembled into logic gates. Right?"

My statement is obviously a silly thing to say. Watson is both algorithms and transistors, depending on how you care to think about it. If you believe that your statement is not equally silly, please explain.

Re:IBM's "Watson" finally ready for prime-time Jeopardy by hencq on Thursday February 10, 2011 @12:25PM (#2202739)
Well HAL 9000, while cold and calculating seems to be scared when he's being turned off. So I'm not sure I agree there are no emotions. Who knows, maybe things like emotion just appear as side effects of the simulation once it becomes complex enough.
Re:IBM's "Watson" finally ready for prime-time Jeopardy by jerhinesmith on Thursday February 10, 2011 @12:41PM (#2202812)
I'm not sure using a fictional computer is helping your argument.
Re:IBM's "Watson" finally ready for prime-time Jeopardy by hencq on Thursday February 10, 2011 @04:22PM (#2203811)
My only argument is that I disagree that the fictional computers named showed no emotion.
Re:IBM's "Watson" finally ready for prime-time Jeopardy by ugh on Thursday February 10, 2011 @11:20AM (#2202386)
A simulation of what?

It can actually answer Jeopardy questions. As good or better than the best Jeopardy player on the planet. (We will see.) Another task, previously only conquered by evolution, now conquered by algorithms written by humans. Watson doesn’t pretend to be good at Jeopardy, it just is.

Re:IBM's "Watson" finally ready for prime-time Jeopardy by losvedir on Thursday February 10, 2011 @02:23PM (#2203301)
> It can actually answer Jeopardy questions.

I think you mean, it can actually question Jeopardy answers.

Sigh... I always hated that about the show.

Re:IBM's "Watson" finally ready for prime-time Jeopardy by ugh on Thursday February 10, 2011 @02:50PM (#2203389)
That sounds like a fun diversion!

No, I most definitely mean that it can actually answer Jeopardy questions. Formulating sentences oddly doesn't turn questions into answers and answers into questions. You could define "question" and "answer" as sentences with a certain syntax but that would be an extremely stupid definition.

Re:IBM's "Watson" finally ready for prime-time Jeopardy by gjm11 on Thursday February 10, 2011 @11:28AM (#2202427)
> Another task, previously only conquered by evolution

I'm pretty sure that Jeopardy performance as such has not been strongly selected for among the ancestors of present day H. sapiens.

(And the related things that may have been -- effective language use, good memory, etc. -- are not so obviously "conquered by algorithms written by humans" however well Watson does.)

Re:IBM's "Watson" finally ready for prime-time Jeopardy by ugh on Thursday February 10, 2011 @11:48AM (#2202542)
That sentence was written for its poetic impact, not its accuracy, I think it’s nevertheless somewhat defensible. Humans were obviously never selected for playing Jeopardy and evolution didn’t in that sense “conquer” Jeopardy (like dinosaurs “conquering” flying) but evolution nevertheless produced humans which are very good at playing Jeopardy. (We know of nothing else in this universe that can even only understand the rules of Jeopardy. Except for human-built machines.) That we can build a machine which is just as good as we are at playing the game obviously doesn’t mean that this machine is as intelligent as humans, it’s nevertheless quite impressive.
Re:IBM's "Watson" finally ready for prime-time Jeopardy by JoeAltmaier on Thursday February 10, 2011 @11:27AM (#2202424)
It can simulate an intelligence answering Jeopardy questions.
Re:IBM's "Watson" finally ready for prime-time Jeopardy by ugh on Thursday February 10, 2011 @12:52PM (#2202869)
It actually answers questions, no trickery involved. It might not use the same algorithms humans use to answer those questions but that isn’t really that important, nobody ever claimed it does.

I don’t see the simulation. I see a machine that is genuinely good at playing Jeopardy.

Re:IBM's "Watson" finally ready for prime-time Jeopardy by demallien on Thursday February 10, 2011 @11:43AM (#2202512)
And how will we know that Watson actually feels fear, or will we just get someone else saying "Watson is a simulation, a clever puppet designed to mimic human behavior" response?

Anyway, the answer to this type of conundrum is simple and well-known: http://en.wikipedia.org/wiki/Turing_test

Of course it should be noted that we aren't there yet for Watson. Even in the restricted domain of a game show, when Watson fails, it does so with a different mode, compared to humans, so we can identify that it isn't actually a human.

Re:IBM's "Watson" finally ready for prime-time Jeopardy by defen on Thursday February 10, 2011 @10:10PM (#2205001)
> Anyway, the answer to this type of conundrum is simple and well-known: http://en.wikipedia.org/wiki/Turing_test

I prefer the Voight-Kampff test:

1. It’s your birthday. Someone gives you a calfskin wallet. How do you react?

2. You’ve got a little boy. He shows you his butterfly collection plus the killing jar. What do you do?

3. You’re watching television. Suddenly you realize there’s a wasp crawling on your arm.

etc.

Re:IBM's "Watson" finally ready for prime-time Jeopardy by mkramlich on Friday February 11, 2011 @05:11AM (#2205797)
"Decker, will I die?"
Re:IBM's "Watson" finally ready for prime-time Jeopardy by nl on Friday February 11, 2011 @12:59AM (#2205360)
The biggest problem I have with the Turing test is that many humans can fail it.

The best bots can already carry on conversations better than a low-intelligence human who isn't concentrating on the task.

It's generally possible to distinguish bots by asking more probing questions. The problem with that is as the Watson project shows it is quite possible to build a computer system that can do well on hard questions too.

That leaves emotional-response type questions, but many of those a culturally specific, and so can really only identify something as being either a bot OR a person from a different culture.

My view is that the Turing test is much closer to being passed than people think, if you specify a Turing test that all humans can pass.

Re:IBM's "Watson" finally ready for prime-time Jeopardy by mkramlich on Friday February 11, 2011 @05:09AM (#2205792)
> The biggest problem I have with the Turing test is that many humans can fail it.

This is precisely the reason why I think AI has so much potential.

It doesn't have to be smarter than the smartest human to be of any use. If it's at least as smart and knowledgeable as a fairly dumb or ignorant person, then it could be incredibly useful. What's the use of building a fleet of robot servants if we can't load them with an AI which is at least smart enough to carry out chores, follow orders and communicate about everyday objects. We don't have to load them each with Einstein AI, just Bubba AI would be a big win.

Re:IBM's "Watson" finally ready for prime-time Jeopardy by nl on Friday February 11, 2011 @06:07AM (#2205901)
Yes, I agree.

Too often researchers think that AI must be perfect under all conditions. The truth is that we adapt our usage of tools to their limitations all the time, which makes me think that AI-powered vision systems that work well in some limited circumstances would still be very useful.

Re:IBM's "Watson" finally ready for prime-time Jeopardy by mattmanser on Thursday February 10, 2011 @12:48PM (#2202851)
Personally I don't think the answer is the turing test, it is a limited test of intelligence.

There's also no guarantee we wouldn't be able to brute force it in time, just as deep blue was mere brute forcing. Impressive technologically, disappointing intellectually.

When I think of intelligence I think of intuition, creativity, flexibility and the ability to learn. The turing test is a simple test along a long path.

I don't think the answer of your conundrum is simple and well known.

Re:IBM's "Watson" finally ready for prime-time Jeopardy by demallien on Thursday February 10, 2011 @01:08PM (#2202952)
You don't understand what the Turing Test is all about. It isn't testing intelligence, it is an attempt to answer the question "Can machines think?". It's all there in that Wikipedia link that I posted.

Also, what makes you think that what goes on in your own brain isn't just another form of "brute-forcing"? What makes one implementation of thinking "thinking" and another form just "brute-force"? And then, brute-forcing is the technique of trying every possible solution - a Turing Machine must be able to move in a near infinite solution space, so brute-forcing is not actually possible.

Re:IBM's "Watson" finally ready for prime-time Jeopardy by Qz on Thursday February 10, 2011 @03:51PM (#2203654)
It's really more like "Can we fool ourselves into believing that machines think?" which isn't actually any different from the question "Can we fool ourselves into believing other people think?"
Re:IBM's "Watson" finally ready for prime-time Jeopardy by blauwbilgorgel on Thursday February 10, 2011 @04:04PM (#2203716)
He does understand. The Turing test is to answer if machines can feign human intelligence. To pass a Turing test, feigning (not necessarily possessing) intelligence is enough.

The answer to insight into a system's qualia is not a Turing test:

Watson, tell us, do you feel fear? Crunching through some look-up tables Yes!

What did that prove about Watson feeling fear or not? We could have Alice talking with Watson for hours on end about fear and daddy issues, without them even knowing the taste of fruit.

That is why the Turing test is an incomplete test for human-like machine intelligence. You seem to equate feigning intelligence, with possessing intelligence. Feigning fear with possessing fear.

Re:IBM's "Watson" finally ready for prime-time Jeopardy by demallien on Thursday February 10, 2011 @04:42PM (#2203909)
Ugh. No, I repeat, the Turing Test is not about intelligence - it's about whether or not the entity in question can think. Please, read the link I posted, it's all in there.

Also, where on Earth do I equate feigning intelligence with possessing intelligence. You're just making that up.

Re:IBM's "Watson" finally ready for prime-time Jeopardy by blauwbilgorgel on Thursday February 10, 2011 @05:55PM (#2204225)
I had to read the original paper in the first week of college, so my knowledge may be a little rusty, but wasn't the paper titled: Computing Machinery and Intelligence?

I'm sure the question was asked: Can machines think? But passing the Turing Test doesn't answer this question. It answers a different question: What will happen when a machine takes the part of A in this game? Will the interrogator decide wrongly as often when the game is played like this as he does when the game is played between a man and a woman?

Its up to you if you take an affirmative answer to those questions to also answer the question it replaces: "Can machines think?" The imitation game does not aim to proof anything to this point. It aims to support its replacement questions, which we have to take at face value: that imitation is just as good (for all sense and purposes) as the real thing.

Also, you write: >And how will we know that Watson actually feels fear? The answer to this type of conundrum is simple and well-known: a Turing test.

If I make a chatscript that tricks you into thinking it was a person feeling fear, by your own logic, you would deem that chatscript to be thinking and actually capable of intelligent conversation, even if you were told afterward it was just some lines of code, feigning you with a (if input, output: yes), it still passed the test, so your answer is: those binary bits must feel fear (or you agree that you apply the Turing Test where it makes no sense).

What entities are really feeling and how to communicate this, has no simple known answer. There have been century-old debates about Qualia. The answer certainly isn't an imitation game, if you insist it is, you are equating feigning with truly possessing. (Or you are suggesting I am a P-zombie and I take offense to that!)

Re:IBM's "Watson" finally ready for prime-time Jeopardy by demallien on Thursday February 10, 2011 @06:48PM (#2204434)
Passing the Turing Test is a bit (a lot!) harder than fooling someone that isn't paying attention. The computer has to respond reasonably to any conversational gambit offered by someone actively seeking to probe the computer. Can the computer correctly identify a pun? Does it have enough "common sense" to identify nonsense phrases such as "the waterfall ran up the aide of the mountain"? Does it understand the difference between a running stream, a running man and a running engine?

If your chatscript can negotiate this type of test, then it would satisfy me that it was thinking.

Re:IBM's "Watson" finally ready for prime-time Jeopardy by blinks on Thursday February 10, 2011 @04:08PM (#2203733)
What is intuition? What is flexibility? How do you test these things in a lab? Turing's test is based on the most straightforward way of measuring intelligence (loaded word, but common; here I'm specifically talking about "intuition, creativity, flexibility and the ability to learn").

If you can have an interview with a computer, and an interview with a human, and be unable to determine which is which (accurately, over several trials), how can you argue that the computer isn't human-like? Most versions of the test have ways of eliminating everything but the straight communication of information (because whether you can build a convincing robot or amazing TTS software is a different problem).

How do you know that I'm not a computer?

Re:IBM's "Watson" finally ready for prime-time Jeopardy by adsr on Thursday February 10, 2011 @12:07PM (#2202651)
I agree about the simulation part, does it have a sense of self? Or can pose questions to itself such as "I think therefore I am"?