News for hackers. Stuff that matters.
Re:IBM's Watson starts on Jeopardy Tonight by icefox on Monday February 14, 2011 @12:22PM (#2217595)
The real question I have is according to that episode Watson does not take into account the category only the 'answer' and the already shown questions. It seems _really_ odd that they would ignore this bit of information.
Re:IBM's Watson starts on Jeopardy Tonight by jarin on Monday February 14, 2011 @01:02PM (#2217775)
Since there are a lot of pun-based categories on Jeopardy, I can understand why they would have problems with it.
Re:IBM's Watson starts on Jeopardy Tonight by jhamburger on Monday February 14, 2011 @03:02PM (#2218367)
They could at least factor it in selectively, in obvious situations. For example, all categories in jeopardy that contain a quoted string include that string in all of the answers. Wouldn't be too hard to use that information.

edit: furthermore, sometimes it's impossible to narrow down the answer if you don't understand the category. For example, if the category is '"C" you later' or something, there might be like 8 possible synonyms that fit, but only one starts with a "C".

Re:IBM's Watson starts on Jeopardy Tonight by brown9-2 on Monday February 14, 2011 @01:10PM (#2217810)
Exactly - the category label probably is very little help in narrowing down possible answers to a text-processing algorithm.
Re:IBM's Watson starts on Jeopardy Tonight by ryanc on Monday February 14, 2011 @02:59PM (#2218349)
This is a significant disadvantage for some categories. For example one category from Friday was "WARE"-ING with each question containing "ware" in the response.

After typing out this comment it occurs to me that if you carefully consider each answer there is only only logical question for all the answers in this category. Although I don't have any specific examples, there are times when a question is ruled incorrect because of the category name (e.g The category called for a specific number of letters in the response).

Re:IBM's Watson starts on Jeopardy Tonight by icefox on Monday February 14, 2011 @02:20PM (#2218162)
I would have to disagree. Every bit of information helps. I was even surprised that they didn't implement a voice to text system so that he could learn what the other contestable guessed incorrectly and utilize that information if only to not guess the same thing on his turn.
Re:IBM's Watson starts on Jeopardy Tonight by kenjackson on Monday February 14, 2011 @03:03PM (#2218371)
They have added this. This was actually a problem in earlier versions where it would sometimes guess the exact same wrong answer as a previous contestant.
Re:IBM's Watson starts on Jeopardy Tonight by dandelany on Monday February 14, 2011 @08:53PM (#2219696)
<spoiler>This happened on the first episode tonight... Ken Jennings guessed "1920s" and Watson guessed the same thing</spoiler>

Either they ended up not implementing this, or Watson didn't hear him correctly :)

Re:IBM's Watson starts on Jeopardy Tonight by brown9-2 on Monday February 14, 2011 @09:19PM (#2219790)
The problem could have been that Jennings said "the twenties" which a computer may not have recognized as the same thing as "the nineteen twenties"
Re:IBM's Watson starts on Jeopardy Tonight by rst on Monday February 14, 2011 @12:32PM (#2217644)
IIRC, they said they fixed that.
Re:IBM's Watson starts on Jeopardy Tonight by icefox on Monday February 14, 2011 @02:17PM (#2218143)
They said in the end of the episode that they started feeding him the correct questions once they are known (Thus in the example learning that all of the questions are names of months), but they didn't mention the categories that I saw.