News for hackers. Stuff that matters.
Re:Google increasingly is promoting a single answer for many... by maxerickson on Friday November 17, 2017 @09:28AM (#15722197)
There's no margin of error for the test they did, just potential sampling bias.

Given the 5000 questions they asked, the system will provide the wrong answer 2.6% of the time. Every time, until they improve it. There's a chance that they managed to ask the only 150 questions that it doesn't know the answer to, but not a very big one.

Re:Google increasingly is promoting a single answer for many... by johnhenry on Friday November 17, 2017 @12:55PM (#15724248)
I agree -- given the sample space, there is not effective way to calculate the margin of error. Even so, I don't think that there are many examples of non-deterministic mechanisms that produce the correct answer 97% of the time.