We have the ability to parse out questions and return answers at the level of Jeopardy champions with Watson. Today, Watson would have been #113 on the supercomputer 500. In 2005, it would have been #3. #113 in 2005 was a cluster of 1024 Xeon 2.4Ghz.
I hate doing apples to oranges, but the only comparison I could find was from cpubenchmark.net, which puts the Xeon 2.5ghz as 381 on their propriatary PassMark. A $335 E3-1275 runs a 9,109 with 4 cores. That's back of the napkin 20-25 times faster. Let's go with 20, extrapolate and say within six years a n equivalent 64-processor machine would be sufficient for Watson-level performance, well within the range of an individual lab, with "good-enough" voice recognition!
The last piece here is conversational flow. Chatbots have demonstrated that we're nowhere near yet. That's algorithmic as much as anything, but it's a pretty big topic in computational linguistics, so I'm hoping we'll have that cracked soon.
Expert systems look to be reasonable in 5-10 years with fluency, with conversational AI not far behind. We know what we need. It's not an unknown problem at this point, for the most part.
Most human contestants (at the champion level) know the answers to most the questions. The gamesmanship, according to the all-time Jeopardy champion Ken Jennings in a recent Fresh Air interview (Jennings returned to the show to take on Watson) is in the button press timing.
Watson has superb accuracy.
The computer actually knew the answers to fewer questions than the humans, but when Watson did know the answers, it always got the buzzer.
Helps to pull back the curtain a bit at times.
True AI and speech are hard. They're getting good. Scary good at times. There's an Android voice-to-voice translation app I've used to communicate with a Mandarin speaker (I manage just a few phrases). After doing that, I spent about fifteen minutes just staring at my phone and realizing that another huge piece of my future was now my present.
And I know the pieces behind it: voice recognition (cloud-assisted), translation, speech synthesis. But it's still mind-bogglingly cool. To me at least.
For my kids, probably not so much.
My point was more that we know what's left. That hasn't been the case before the last five years or so.