Re:Jeopardy Champion Ken Jennings Q&A about IBM Watson
by jbri on Wednesday February 16, 2011 @04:27PM
(#2228381)
AFAIK, Watson was just using the light signal to decide when to start buzzing in. Just the light, ignoring when Trebek was going to finish saying something.
Presumably a human could consistently beat Watson to the buzzer by predicting when the light would go on.
Re:Jeopardy Champion Ken Jennings Q&A about IBM Watson
by gojomo on Wednesday February 16, 2011 @05:24PM
(#2228606)
Not sure about 'consistently', though trying to predict the light seems a reasonable strategy to attempt.
There's a lock-out that applies if you buzz too early, and the variance of the 'beats' between Trebek's finish and the light, if that's a human-mediated process, may be far larger than Watson's light-fired reaction time.
Re:Jeopardy Champion Ken Jennings Q&A about IBM Watson
by pkamb on Wednesday February 16, 2011 @03:42PM
(#2228196)
The easiest and fairest fix would be to hook Watson's buzzer up to a dataset of previous Tournament of Champion question-winning buzzer times. Or just use Ken and Brad's previous buzzer times for even more control. Pick a new human-achievable reaction time for every question.
• receives question (and answers) as coded text, rather than having to sight-read or listen to them
• no audio/video clues
• no categories that require an extra Trebek-explanation
It may even be receiving a direct signal when it's OK to ring in, rather than assessing Trebek's cadence and the same light-indicator as the human contestants rely upon.
So other 'balancing' changes shouldn't be out of the question.
I particularly like the idea that the penalty for a moment-too-early buzzing could be eliminated, and/or treating all buzzes in a small window around the traditional earliest-allowed moment as simultaneous. That still rewards quickness, without heavily advantaging the computer's ability to perfectly synchronize with the buzzing-period.
Once two buzzes are considered simultaneous, the contestant chosen to answer could rotate in round-robin fashion, or (for maximum drama) be the one furthest behind.