News for hackers. Stuff that matters.
Re:Chatbot Hallucinations Are Poisoning Web Search by BobaFloutist on Thursday October 05, 2023 @04:37PM (#37783987)
The thing is when you call a human on bullshit, they usually can't back it up well enough to pass the smell test. When you call an AI on bullshit it can instantly fabricate plausible, credible seeming sources/evidence.

A human's lie is different than an AI's hallucination, since it's still based on (distorting) the truth, whereas the hallucination is based on an invented reality (yes I know it's applied statistics and there's no true model of the world in there, but it can report as if there is)

Re:Chatbot Hallucinations Are Poisoning Web Search by ryanklee on Thursday October 05, 2023 @04:57PM (#37784203)
Intelligent people can fill the void of ignorance with plausible sounding but factually incorrect information. They are apt to engage cognitive biases in such a way that the biases produce assertions that are deeply indistinquishable from factual assertions. They fool themselves in this way and they fool others. This happens all the time.

LLMs are no different in this respect.

Re:Chatbot Hallucinations Are Poisoning Web Search by TerrifiedMouse on Thursday October 05, 2023 @10:02PM (#37786450)
Sure people lie and spread misinformation (willingly or unwittingly). But coming up with plausible sounding lies take effort.

LLMs on the other hand are amazing and prolific liars and can produce a lot of bullshit for a price that’s effectively free - in fact it’s cheaper to create a LLM that’s inaccurate than one that’s … less inaccurate. The truth to lie ratio on the internet is about to take a huge hit. LLMs really are a Pandora’s Box.

Re:Chatbot Hallucinations Are Poisoning Web Search by gyudin on Thursday October 05, 2023 @05:59PM (#37784822)
It’s not a big deal, there are many ways to handle it. It just has some overhead costs. LLMs that are offered to general public are more of a POC and they are making sure to use as little resources as possible.
Re:Chatbot Hallucinations Are Poisoning Web Search by 127 on Friday October 06, 2023 @03:23AM (#37788034)
Evidence can easily be cross referenced and if the link LLM gives is dead it means it's lying.