News for hackers. Stuff that matters.
Re:Google increasingly is promoting a single answer for many... by maxerickson on Friday November 17, 2017 @08:52AM (#15721924)
97% accuracy is abysmal for something you are presenting as "answers".
Re:Google increasingly is promoting a single answer for many... by yathern on Friday November 17, 2017 @10:13AM (#15722559)
If there was someone I knew who I could ask a question, with a 97% chance they were correct, I'd consider them to be a phenomenon, and an extremely valuable resource. For some definition of correct, I'd be happy to be 60% accurate.
Re:Google increasingly is promoting a single answer for many... by maxerickson on Friday November 17, 2017 @09:46PM (#15727523)
Yeah but what if you got to choose between 2 people that knew the answer 50% of the time but one of the them enjoyed making up answers when they didn't know and the other just told you they didn't know?
Re:Google increasingly is promoting a single answer for many... by retSava on Friday November 17, 2017 @10:02AM (#15722431)
What you/we need is a healthy dose of taking things with a grain of salt and not just blindly trust what we read/hear.

This goes not only for results in search services today, but was also valid in the time before this, when we used encyclopedias, or asked someone.

Re:Google increasingly is promoting a single answer for many... by astrodust on Friday November 17, 2017 @02:35PM (#15725279)
This is not about "a grain of salt". Imagine you're a ten year old kid and you're looking for answers on some subject, say the Holocaust. What if all the "answers" you're getting are from far-right hate groups? How do you think that will affect that person?

Likewise, if you're looking for medical advice and you're getting nothing but anti-science woo, can we really be surprised that anti-vaxxers are becoming more numerous? These outbreaks of deadly, yet preventable diseases have serious fatal consequences for many.

"Grain of salt" means fuck all when people are dying from bad answers. You can't learn from your mistakes when you're dead.

At least Google could frame these with the idea of keeping a skeptical mind, but they should probably stop surfacing things as "the answer" and instead as "top search result".

Re:Google increasingly is promoting a single answer for many... by maxerickson on Friday November 17, 2017 @10:19AM (#15722607)
I'm not sure why you feel the need to comment on how credulous I might be.

Anyway, the 97% is an impressive result, it just isn't so impressive as to be beyond criticism. My comment is a little over the top, in response to the other comment that sets the bar at effusive praise being the only proper analysis of the system.

Re:Google increasingly is promoting a single answer for many... by Gigablah on Friday November 17, 2017 @09:07AM (#15722015)
It’s good enough for my professor :)
Re:Google increasingly is promoting a single answer for many... by johnhenry on Friday November 17, 2017 @09:21AM (#15722145)
Not sure what the margin of error is on these things, but generally 97% should probably be considered 100%.
Re:Google increasingly is promoting a single answer for many... by maxerickson on Friday November 17, 2017 @09:28AM (#15722197)
There's no margin of error for the test they did, just potential sampling bias.

Given the 5000 questions they asked, the system will provide the wrong answer 2.6% of the time. Every time, until they improve it. There's a chance that they managed to ask the only 150 questions that it doesn't know the answer to, but not a very big one.

Re:Google increasingly is promoting a single answer for many... by johnhenry on Friday November 17, 2017 @12:55PM (#15724248)
I agree -- given the sample space, there is not effective way to calculate the margin of error. Even so, I don't think that there are many examples of non-deterministic mechanisms that produce the correct answer 97% of the time.
Re:Google increasingly is promoting a single answer for many... by jgalt212 on Friday November 17, 2017 @10:08AM (#15722506)
a parser that is 97% correct is broken.
Re:Google increasingly is promoting a single answer for many... by Kurtz79 on Friday November 17, 2017 @10:58AM (#15723025)
A parser (assuming you are talking about a programming language parser) has the luxury of having highly structured and deterministic inputs, and to be able to refuse giving an "answer" if they are not.
Re:Google increasingly is promoting a single answer for many... by jgalt212 on Friday November 17, 2017 @01:03PM (#15724337)
> highly structured and deterministic inputs

not all parsers deal with such inputs, and parsers that don't can and often do produce multiple interpretations of the input data.

Re:Google increasingly is promoting a single answer for many... by Kurtz79 on Monday November 20, 2017 @05:26AM (#15738968)
Tell me of some parsers that do not deal with deterministic inputs and have 100% accuracy, then.
Re:Google increasingly is promoting a single answer for many... by astrodust on Friday November 17, 2017 @02:36PM (#15725296)
It's like Intel's floating point math used to be about 97% correct. Good enough, right?

https://en.wikipedia.org/wiki/Pentium_FDIV_bug