Also, as pointed out in that thread, this is no different than a regular Jeopardy game. One game consists of dozens and dozens of questions. If Watson answers them all correctly and the humans get zero points, that is indeed statistically significant.
If the score is close, then repetition in games will be necessary. The problem with the assumption in that thread is that one Jeopardy game is vastly different than the next. In reality, you could string together a bunch of games and call it one game. Or take one game and split it up into 50 "games". The point is, inside one game, there are enough different questions to definitely count as statistically significant.
Even on the question level, a disclaimer should be given if Watson doesn't answer enough questions for statistical significance.
Finally, the issue here is with contributing to the statistical ignorance of people watching the two game match. Sure, Watson has played many games already before the match but that's not what's being shown on TV.
http://www.quora.com/Does-IBM-Watson-Jeopardy-match-contribu...