News for hackers. Stuff that matters.
Re:I want flexible queries, not RAG by dheera on Tuesday May 21, 2024 @06:13PM (#40434703)
By far the best way I've found to reduce hallucinations is to explicitly allow the model to say some version of "I don't know" in the prompt.
Re:I want flexible queries, not RAG by knifie_spoonie on Tuesday May 21, 2024 @08:55PM (#40436171)
That's really interesting. Can you give any examples of how you do that?
Re:I want flexible queries, not RAG by batch12 on Tuesday May 21, 2024 @09:57PM (#40436580)
[...] if you don't know the answer, say 'I don't know' [...]
Re:I want flexible queries, not RAG by pfannkuchen on Wednesday May 22, 2024 @02:28AM (#40437915)
This technique also helps to prevent hallucinations in human children.
Re:I want flexible queries, not RAG by mewpmewp2 on Wednesday May 22, 2024 @04:01AM (#40438466)
It however has been shown not to help with politicians.
Re:I want flexible queries, not RAG by bigfudge on Wednesday May 22, 2024 @04:37AM (#40438733)
How? Do you just mean a simple way that they could say I don’t know but tend not to?
Re:I want flexible queries, not RAG by mewpmewp2 on Wednesday May 22, 2024 @05:11AM (#40438957)
Politicians are compelled to hallucinate even when they are told that saying "I don't know" is okay.
Re:I want flexible queries, not RAG by davedx on Wednesday May 22, 2024 @07:03AM (#40439545)
Yup I have this as default for a Discord bot I run in a stocks chat. If the bot is unsure then the LLM says so and the bot keks you instead of making something up