News for hackers. Stuff that matters.
Re:IBM Watson's team Q&A on reddit by gojomo on Wednesday February 23, 2011 @07:03PM (#2256368)
Alas, my somewhat-skeptical question came in late and got little support:

http://www.reddit.com/r/IAmA/comments/fnfg3/by_request_we_ar...

What determined the use of exactly 10 racks of 9 maxed-out (32-core, 512GB RAM) 4U Power750 servers? For example, would Watson have done better with more hardware? Or could it have made-do with far less, after all the bulk pre-processing of, and training on, source material was finished?

(My intuitions about the necessary amount of reference data and topical associations – written up at http://redd.it/fnixm – made me think way less hardware should have been required, at least at the very end during the match.)

Re:IBM Watson's team Q&A on reddit by whatusername on Wednesday February 23, 2011 @07:15PM (#2256402)
Tony Pearson wrote a bunch of stuff about Watson. https://www.ibm.com/developerworks/mydeveloperworks/blogs/In... Had a bunch of details including some performance details...

Single core -- 1 -- 2 hours

Single IBM Power750 server -- 32 -- < 4 minutes

Single rack (10 servers) -- 320 -- < 30 seconds

IBM Watson (90 servers) -- 2,880 -- < 3 seconds

https://www.ibm.com/developerworks/mydeveloperworks/blogs/In... Had details on the data/storage/ram:

When Watson is booted up, the 15TB of total RAM are loaded up, and thereafter the DeepQA processing is all done from memory. According to IBM Research, "The actual size of the data (analyzed and indexed text, knowledge bases, etc.) used for candidate answer generation and evidence evaluation is under 1TB." For performance reasons, various subsets of the data are replicated in RAM on different functional groups of cluster nodes. The entire system is self-contained, Watson is NOT going to the internet searching for answers.

Re:IBM Watson's team Q&A on reddit by blhack on Wednesday February 23, 2011 @07:24PM (#2256433)
I wonder if this is marketing.

IBM makes BIG HUGE MASSIVE (tm) server clusters that have lots of blinkenlights and require lots of power and are so crazy and huge and awesome that the people working at IBM must be hyper-geniuses!

vs

Watson runs on a laptop.

Re:IBM Watson's team Q&A on reddit by whatusername on Wednesday February 23, 2011 @08:24PM (#2256581)
Watson can run on a laptop.

It just can't get the answers fast enough to win Jeopardy. https://www.ibm.com/developerworks/mydeveloperworks/blogs/In...

Re:IBM Watson's team Q&A on reddit by brisance on Wednesday February 23, 2011 @07:40PM (#2256479)
I can't see how that would be marketing. Most people would be more impressed if Watson could run on a laptop, today. I know I would.
Re:IBM Watson's team Q&A on reddit by gojomo on Wednesday February 23, 2011 @08:07PM (#2256538)
More impressed? Yes. More willing to spend millions on hardware and software? No.
Re:IBM Watson's team Q&A on reddit by brisance on Wednesday February 23, 2011 @09:01PM (#2256658)
And how would they look if, as the original poster surmised, it were possible for a competitor to produce something similar to Watson on today's laptop? IBM would've spent millions of dollars making themselves look very silly.

It's a similar situation to moon-landing skepticism. If it didn't happen, it would be trivial for the Soviet Union to disgrace and discredit the achievement by faking their own.

Re:IBM Watson's team Q&A on reddit by gojomo on Wednesday February 23, 2011 @09:12PM (#2256683)
No other team was given a crack at the Jeopardy spotlight. IBM didn't win against a bunch of other teams for the slot on the human/machine faceoff; it was all orchestrated for them. So give others some time to emerge.

I suspect in a year or two – perhaps sooner, if an organized open competition with real cash prizes is launched – we'll have a better idea of what a lean team could do on the trivia domain. It may not be reduced to a single 2011-equivalent laptop... but it might be a single 2011-equivalent maxed-out-server (rather than a Watson-like server room).

Re:IBM Watson's team Q&A on reddit by wtallis on Wednesday February 23, 2011 @08:24PM (#2256577)
I can see IBM charging customers millions a year to keep their Watson database up to date, even if it ends up running on an x86 Linux box. When they adapt it for general Q&A use, Watson will probably be as useful as Wolfram Alpha wishes it was.
Re:IBM Watson's team Q&A on reddit by blhack on Thursday February 24, 2011 @11:56AM (#2258709)
Most programmers would, but any non-technical people would think that you could hire a programmer to do the same thing for $1000.