Single core -- 1 -- 2 hours
Single IBM Power750 server -- 32 -- < 4 minutes
Single rack (10 servers) -- 320 -- < 30 seconds
IBM Watson (90 servers) -- 2,880 -- < 3 seconds
https://www.ibm.com/developerworks/mydeveloperworks/blogs/In... Had details on the data/storage/ram:
When Watson is booted up, the 15TB of total RAM are loaded up, and thereafter the DeepQA processing is all done from memory. According to IBM Research, "The actual size of the data (analyzed and indexed text, knowledge bases, etc.) used for candidate answer generation and evidence evaluation is under 1TB." For performance reasons, various subsets of the data are replicated in RAM on different functional groups of cluster nodes. The entire system is self-contained, Watson is NOT going to the internet searching for answers.
IBM makes BIG HUGE MASSIVE (tm) server clusters that have lots of blinkenlights and require lots of power and are so crazy and huge and awesome that the people working at IBM must be hyper-geniuses!
vs
Watson runs on a laptop.
It just can't get the answers fast enough to win Jeopardy. https://www.ibm.com/developerworks/mydeveloperworks/blogs/In...
It's a similar situation to moon-landing skepticism. If it didn't happen, it would be trivial for the Soviet Union to disgrace and discredit the achievement by faking their own.
I suspect in a year or two – perhaps sooner, if an organized open competition with real cash prizes is launched – we'll have a better idea of what a lean team could do on the trivia domain. It may not be reduced to a single 2011-equivalent laptop... but it might be a single 2011-equivalent maxed-out-server (rather than a Watson-like server room).
http://www.reddit.com/r/IAmA/comments/fnfg3/by_request_we_ar...
What determined the use of exactly 10 racks of 9 maxed-out (32-core, 512GB RAM) 4U Power750 servers? For example, would Watson have done better with more hardware? Or could it have made-do with far less, after all the bulk pre-processing of, and training on, source material was finished?
(My intuitions about the necessary amount of reference data and topical associations – written up at http://redd.it/fnixm – made me think way less hardware should have been required, at least at the very end during the match.)