Q: Seemed to me, for many of the questions, that the computer was just
better at buzzing in. Does Watson have an unfair advantage for timing the
buzz-in?
A: As Jeopardy devotees know, if you're trying to win on the show, the buzzer is
all. On any given night, nearly all the contestants know nearly all the
answers, so it's just a matter of who masters buzzer rhythm the best.
Watson does have a big advantage in this regard, since it can knock out a
microsecond-precise buzz every single time with little or no variation. Human
reflexes can't compete with computer circuits in this regard. But I wouldn't
call this unfair...precise timing just happens to be one thing computers are
better at than we humans. It's not like I think Watson should try buzzing in
more erratically just to give homo sapiens a chance.They should try to pick questions such that the contestants only know about 1/3 of them.
Then lets see how the computer does.
This is (should be) a contest of knowledge not buzzing.
If it's much higher than 50%, I would say that a significant portion of Watson's advantage derives not from the language processing but the response time / mechanical advantages.
If the exact timing of buzzing in – and not 'first' but 'first after a light goes on'– gave an overwhelming advantage to Watson, that could be eliminated, too. For example, why not just 'first to buzz in'? (That is, no penalty for being early?) Let Watson's parsing of the question text race the humans' sight-reading.
It looked to me like the humans usually won the buzzer on short questions, which strongly suggests it was the slowness of reading long questions that put it on par with the humans in knowledge, and then it crushed them on buzzing-after-the-light precision.