News for hackers. Stuff that matters.
Re:Introducing Agents in Haystack: Make LLMs resolve complex... by azinman2 on Tuesday April 04, 2023 @12:42PM (#35442406)
If you ask a flat earther where they recommend eating, they’re not going to interweave restaurants that exist with restaurants that don’t, but have plausible sounding restaurant names. Or if you ask for the web address of those restaurants, the flat earther will say “I don’t know, google it.” They won’t just make up plausible sounding URLs that don’t actually exist.

Hallucinations for LLMs are at a different level and approach every subject matter. Because it’s all just “predict the next word,” not “predict the next word but only if it makes sense to do so, and if it doesn’t, say you’re not sure.”

Re:Introducing Agents in Haystack: Make LLMs resolve complex... by SanderNL on Wednesday April 05, 2023 @12:28AM (#35449310)
I understand, it’s a failure mode unique to LLM’s. What I mean is that it has no relation with intelligence. Humans have failure modes too and often quite weird an surprising ones too, but they are different. It’s just that we biased and used to it.