"In 1989 MGonz was able to fool a human subject for over an hour [...]
MGonz worked on a simple principle: don’t reply to statements. Merely
insult the person making the statement. Most of MGonz’s one-liners are
too profane to repeat – but “ah, type something interesting or shut-up”,
“what sort of idiot types something like that”, and “that’s it, I’m not
talking to you anymore!” are fairly representative of the style. The
programme simply pours a torrent of abuse on the unwitting human at the
other end of the internet connection."
[1] http://www.saintsandsceptics.org/the-mgonz-test/There are novelty accounts that only provide praise, so perhaps a nice version could also be created too.
Honestly, this often seems to be the conversational gambit of human beings.
Coming up with genuinely interesting conversation seems to be a task that takes too much effort for most everyday interactions.
Whether it be standard small chat, quoting cultural media, or reciting social group in-jokes, much of human interaction seems to also take a "bags of tricks" approach.
I would much rather see a prize for finding more general purpose algorithms and using them to create general purpose AIs. Off the top of my head, show a picture a animal, building, logo, face, word, etc., and be able to pick out that same type from another group of pictures. Google has already demonstrated that we can teach a computer to recognize a cat with thousands of pictures and deep learning models, how about just one? The more general the test, the better, it should also be able to be trained to play new games and recognize sounds as well as pictures. Unlike another useless,specialized chatbot, this would be better aligned with Xprize's goals of "encouraging technological development that could benefit mankind."
Most animals can't learn language, or play games, and aren't very intelligent.
User: Hi Cleverbot.
Cleverbot: How are you?
User: Fine. Let's talk Physics.
Cleverbot: Okay. Do you like trees?
User: That's a weird non-sequitur. Are familiar with Classical Mechanics?
Cleverbot: No.
User: It's just part of the physics we learn in high-school.
Cleverbot: Ich leibe tokio hotel.
I did, however, witness some potentially interesting if antiquated webdesign, not least a promotion for a potentially more human-like 'friend finder', located at the base of the page. It has 199k 'likes', 20.7k 'follows' and 22.2k 'shares', leading to a strong possibility Cleverbot is merely a pseudo-presence, and the true nature of this website will transpire only by clicking more deeply.
This prize doesn't seem very useful to me. If someone actually was able to pull this off, they would be better off making billions off of that tech in the marketplace instead...
Even if the winner is a bag of tricks trick, it still would be something new in the way it is presented, with new tricks developed, and thereby surely would spark some innovation, would it not?
If so, then the XPrize served its purpose - to drive innovation.
I am not under the impression that XPrizes are intended to be impossible goals or "holy grails" - just goals that drive progress.
Chatbots that perform the best on a traditional Turing Test are all extremely specialized 'bag of tricks' approaches. They can be surprisingly convincing, because they often use huge databases of real human responses to construct their own -- if you haven't already, I'd recommend giving Cleverbot a try[2].
However these chatbots often fail when an important continuity of facts is being discussed in context, where their parrot-like nature is exposed. Therefore I think this "TED XPRIZE" will be much easier to fool in this sense, because there's only two questions from the judges. This essentially removes the most difficult AI challenges of a traditional turing test.
Of course, succeeding at the "TED XPRIZE" would without a doubt require legitimate and significant advancements to the field of artificial intelligence and machine learning. Synthesizing a convincing talk/essay with an engaging narrative and central theme is no easy task (though limited successes already exist [3]).
But even now computers can beat humans in very specialized areas (and specialization is a key requirement to this). For example, we already have human level-facial recognition[4] and superhuman character recognition[5]. Similarly, while it would indeed be a legitimate AI advancement to be able to construct such a speech, I do not believe this would be any more a holy grail of AGI than character recognition and facial recognition. Instead, it would be incremental progress disguising itself as having already arrived.
[1] http://www.xprize.org/ted-rules
[2] http://cleverbot.com
[3] http://www.geekosystem.com/journal-accepts-nonsense-paper/
[4] https://www.facebook.com/publications/546316888800776/
[5] http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.84.1...