News for hackers. Stuff that matters.
Re:Jeopardy Champion Ken Jennings Q&A about IBM Watson by gojomo on Wednesday February 16, 2011 @03:31PM (#2228141)
But the rules have already been bent to help Watson in areas where it's weak:

• receives question (and answers) as coded text, rather than having to sight-read or listen to them

• no audio/video clues

• no categories that require an extra Trebek-explanation

It may even be receiving a direct signal when it's OK to ring in, rather than assessing Trebek's cadence and the same light-indicator as the human contestants rely upon.

So other 'balancing' changes shouldn't be out of the question.

I particularly like the idea that the penalty for a moment-too-early buzzing could be eliminated, and/or treating all buzzes in a small window around the traditional earliest-allowed moment as simultaneous. That still rewards quickness, without heavily advantaging the computer's ability to perfectly synchronize with the buzzing-period.

Once two buzzes are considered simultaneous, the contestant chosen to answer could rotate in round-robin fashion, or (for maximum drama) be the one furthest behind.

Re:Jeopardy Champion Ken Jennings Q&A about IBM Watson by jbri on Wednesday February 16, 2011 @04:27PM (#2228381)
AFAIK, Watson was just using the light signal to decide when to start buzzing in. Just the light, ignoring when Trebek was going to finish saying something.

Presumably a human could consistently beat Watson to the buzzer by predicting when the light would go on.

Re:Jeopardy Champion Ken Jennings Q&A about IBM Watson by gojomo on Wednesday February 16, 2011 @05:24PM (#2228606)
Not sure about 'consistently', though trying to predict the light seems a reasonable strategy to attempt.

There's a lock-out that applies if you buzz too early, and the variance of the 'beats' between Trebek's finish and the light, if that's a human-mediated process, may be far larger than Watson's light-fired reaction time.

Re:Jeopardy Champion Ken Jennings Q&A about IBM Watson by pkamb on Wednesday February 16, 2011 @03:42PM (#2228196)
The easiest and fairest fix would be to hook Watson's buzzer up to a dataset of previous Tournament of Champion question-winning buzzer times. Or just use Ken and Brad's previous buzzer times for even more control. Pick a new human-achievable reaction time for every question.