In other words, if I Google "What year did Tom Hanks land on the moon", the answer box should say "US astronauts landed on the moon in 1970" (not just "1970"). Give users the ability to assess whether the AI was correct.
Google isn't an encyclopedia, it's a search engine. It search inside content and try to find the best content that fit your criteria, it could be from trustworthy source, or not, it could be right or wrong on what you meant. For sure their goal is to give you the closest thing to what you asked, with the best sources, but it's not a guarantee, so it shouldn't be trusted as such.
It's crazy that we all came from the "don't trust Wikipedia" and now some people are arguing that we should be able to trust Google results directly.
Also, everything about Google's "answer" is wrong, from the date, to the people, to the singleton response to a question that should have multiple answers.
Let's all move to DuckDuckGo and Yandex.
When a tool's convenience grows faster than its reliability and quality, this is what often happens (assuming the tool needs to be more than just convenient). This is just one example.
https://www.google.com/search?q=which+president+invented+cof...
Is it an entirely incorrect way? Or does it present a very reasonable pass at what a person was likely to be looking for if they had a recollection that there was a President who invented coffee, but wanted to know who that was?
Unfortunately, the first moon landing happened in 1969, which is an objective fact, so no, Google can't even verify basic facts.
Because people at Google test this feature against their query traffic, measure how many answers are correct and useful, compare it to the number of answers that are wrong and misleading, and use the overall data to decide whether it is on balance more helpful than harmful. With billions of queries flowing through the system, of course you will often make a mistake. The correct strategy is not to set the bar at "zero incorrect answers".
- of profound importance
- obviously unknowable with their current solution, given the absurdity of RM’s screenshots
That’s a pretty dangerous gamble at any moment, but I’d say it’s inherently unethical to take the risk in the current climate.
Not to pick on this person is particular, but this is why I am so against surfacing untrustworthy information as trustworthy.
Google's AI "knows" that Austin is the capital of Texas with the same system that thinks the Wright Brothers flew through the core of the earth. So why the fuck would anyone trust google that the capital of Texas is Austin? Because you think you can intuit the boundaries of what their AI will and won't fuck up? [0] And that's a reasonable burden to put on dummies who already think search engine results are somehow more authoritative than the simple text matching they're based on at their core?
How is anyone at google with a brain comfortable with this feature being live?
But these low hanging, blatantly obvious, wrong things are actually a good thing. Because once the obvious things are fixed the un-obvious ones will linger as even more unwarranted trust is be placed in the feature. And it will become even harder to get it though people's thick skulls how goddamn stupid it is to outsource reasoning to machines that can't fucking reason.
[0] Sure, xkcd asked fundamentally unanswerable questions, but google notoriously spent years getting "how long does it take to caramelize onions" wrong.