News for hackers. Stuff that matters.
Re:Google's Results Are Infested, Open AI Is Using Their Pla... by m_ke on Saturday December 28, 2024 @12:30PM (#42532625)
It would be great if it wasn't completely wrong 50% of the time.
Re:Google's Results Are Infested, Open AI Is Using Their Pla... by GiorgioG on Saturday December 28, 2024 @12:34PM (#42532655)
Describes my general experience with AI across the board. Copilot, ChatGPT, Claude, etc. It’s like I’m talking to a genius toddler. With ChatGPT losing 5 billion dollars on 3.7B in revenue this is unsustainable. It feels like the dotcom bubble all over again.
Re:Google's Results Are Infested, Open AI Is Using Their Pla... by jayd16 on Saturday December 28, 2024 @01:43PM (#42533350)
> genius toddler

I think it's closer to a well spoken idiot.

Re:Google's Results Are Infested, Open AI Is Using Their Pla... by hinkley on Saturday December 28, 2024 @03:51PM (#42534599)
A cat who can talk.
Re:Google's Results Are Infested, Open AI Is Using Their Pla... by Analemma_ on Saturday December 28, 2024 @12:40PM (#42532724)
This is true, but fairly or unfairly, asking a question to a chat bot feels like “opting in” to the possibility that the answers you get will be hallucinated garbage, in a way that doing a Google search does not. It’s a tough problem for Google to overcome— the fact that they will be held to a higher standard—- but that’s what it is: we have already learned to accept bullshit from LLMs as a fact of life, whereas on the top of Google results it feels like an outrage.
Re:Google's Results Are Infested, Open AI Is Using Their Pla... by TeMPOraL on Saturday December 28, 2024 @12:57PM (#42532890)
> we have already learned to accept bullshit from LLMs as a fact of life, whereas on the top of Google results it feels like an outrage.

Sort of. Top results for any kind of question that applies to general population - health, lifestyle, etc. - are usually complete bullshit too. It's all pre-AI slop known as content marketing.

Re:Google's Results Are Infested, Open AI Is Using Their Pla... by scarface_74 on Saturday December 28, 2024 @12:51PM (#42532838)
I have been a paying ChatGPT user for awhile. It’s simply a matter of saying “verify that” and it will give you wen citations
Re:Google's Results Are Infested, Open AI Is Using Their Pla... by ceejayoz on Saturday December 28, 2024 @01:01PM (#42532928)
Aren’t those citations sometimes entirely made up? Like the lawyers who used it for a case and it cited ones that never happened?
Re:Google's Results Are Infested, Open AI Is Using Their Pla... by robrenaud on Saturday December 28, 2024 @01:35PM (#42533269)
I really do think hallucinated references are a thing of the past. Models will still make things up, but they won't make up references.

ChatGPT with web search does a good job of summarizing content.

Re:Google's Results Are Infested, Open AI Is Using Their Pla... by JustExAWS on Saturday December 28, 2024 @01:03PM (#42532950)
No, ChatGPT has had a web search tool for paid users forever. It actually searches the web and you can click on the links
Re:Google's Results Are Infested, Open AI Is Using Their Pla... by Analemma_ on Saturday December 28, 2024 @01:00PM (#42532915)
It invents citations too, constantly. You could look up the things it cites, although at that point, what are you actually gaining?

And I’m not saying this makes them useless: I pay for Claude and am a reasonably happy customer, despite the occasional bullshit. But none of that is relevant to my point that the bots get held to a different standard than Google search and I don’t see an easy way for Google to deal with that.

Re:Google's Results Are Infested, Open AI Is Using Their Pla... by JustExAWS on Saturday December 28, 2024 @01:04PM (#42532958)
Do you pay for ChatGPT? The paid version of ChatGPT has had a web search tool for ages. It will search the web and give you live links.
Re:Google's Results Are Infested, Open AI Is Using Their Pla... by GiorgioG on Saturday December 28, 2024 @05:04PM (#42535206)
ChatGPT has had web search for exactly 58 days. I guess our definitions of 'ages' differ by several orders of magnitude.
Re:Google's Results Are Infested, Open AI Is Using Their Pla... by JustExAWS on Saturday December 28, 2024 @05:19PM (#42535308)
The paid version has had web access for at least a year

March 23rd 2023

https://openai.com/index/chatgpt-plugins/

That’s 666 days.

So you are off by over “one order of magnitude”

Re:Google's Results Are Infested, Open AI Is Using Their Pla... by GiorgioG on Saturday December 28, 2024 @07:53PM (#42536365)
A plugin? You’re joking.
Re:Google's Results Are Infested, Open AI Is Using Their Pla... by JustExAWS on Saturday December 28, 2024 @08:51PM (#42536722)
It’s a “plug in” built into the paid version of ChatGPT, run by default and created by OpenAI.

This isn’t a third party obscure plug in.

All “tools” use a plug in architecture

Re:Google's Results Are Infested, Open AI Is Using Their Pla... by GiorgioG on Saturday December 28, 2024 @09:16PM (#42536821)
You're a troll, and I'm done feeding you.
Re:Google's Results Are Infested, Open AI Is Using Their Pla... by scarface_74 on Saturday December 28, 2024 @11:26PM (#42537514)
What part is “trolling”? Paid users have been able to use ChatGPT using the built in web browsing plug in for over a year just by saying “please provide citations” or “verify that”.

What you say has been around for a few weeks has literally been around for paid users for over a year

Re:Google's Results Are Infested, Open AI Is Using Their Pla... by Kiro on Saturday December 28, 2024 @12:43PM (#42532761)
What are you using it for?
Re:Google's Results Are Infested, Open AI Is Using Their Pla... by traverseda on Saturday December 28, 2024 @12:37PM (#42532677)
That's a very pessimistic take. It's right about 50% of the time!
Re:Google's Results Are Infested, Open AI Is Using Their Pla... by ethbr1 on Saturday December 28, 2024 @12:44PM (#42532774)
Both of your requirements for correctness are just 50% too high.
Re:Google's Results Are Infested, Open AI Is Using Their Pla... by jsheard on Saturday December 28, 2024 @12:52PM (#42532842)
The mark of a great product/feature is always when they feel the need to force it on users, because they know that a significant portion of users would switch it off if they could.
Re:Google's Results Are Infested, Open AI Is Using Their Pla... by binkHN on Saturday December 28, 2024 @12:32PM (#42532637)
I find it mostly right 70% of the time.
Re:Google's Results Are Infested, Open AI Is Using Their Pla... by hinkley on Saturday December 28, 2024 @03:51PM (#42534605)
60% of the time, it works every time.
Re:Google's Results Are Infested, Open AI Is Using Their Pla... by hobs on Saturday December 28, 2024 @12:36PM (#42532670)
Which would be great, except for that I found the top google result to be more than 70% relevant to my searches in the past, its a clear downgrade of relevancy.
Re:Google's Results Are Infested, Open AI Is Using Their Pla... by Ancalagon on Saturday December 28, 2024 @02:30PM (#42533753)
Yeah the AI summaries are garbage still
Re:Google's Results Are Infested, Open AI Is Using Their Pla... by TiredOfLife on Saturday December 28, 2024 @01:09PM (#42533009)
Compared to 0% of relevant results in first 10 pages it's an enormous improvement.
Re:Google's Results Are Infested, Open AI Is Using Their Pla... by jayd16 on Saturday December 28, 2024 @01:45PM (#42533364)
Have you seen an example where the AI hits on something that isn't in the first 10 pages of results?
Re:Google's Results Are Infested, Open AI Is Using Their Pla... by croes on Saturday December 28, 2024 @01:20PM (#42533113)
Wait till the monetizing by ads starts
Re:Google's Results Are Infested, Open AI Is Using Their Pla... by Terr_ on Sunday December 29, 2024 @01:17AM (#42538035)
The difficulty of verifying the answer isn't-wrong is another important factor. Bad search results are often obvious, but LLM nonsense can have tricky falsehoods.

If a process gives false results half the time, and verifying any result takes half as long as deriving a correct solution yourself... Well, I don't know the limiting sum of the infinite series offhand, but it's a terrible tool.