Re:Favorites from our prompt engineering tournament
by six_four_eight on Friday April 05, 2024 @03:23PM
(#39946094)
Towards the end they state: ‘… just adding “do not hallucinate” has been shown to reduce the odds a model hallucinates.’ I find this surprising and doesn’t fit with my understanding of how a language model works. But I’m very much a novice. Would this be due to update training including feedback that marks bad responses with the term “hallucinate”?
[ Parent
| on HN ]
Re:Favorites from our prompt engineering tournament
by ManuelKiessling on Friday April 05, 2024 @03:39PM
(#39946267)
My mental model is “telling a LLM to not make any mistakes is like telling a depressed person to stop feeling bad”.
Re:Favorites from our prompt engineering tournament
by anotheryou on Friday April 05, 2024 @03:53PM
(#39946446)
my model is that you need to tell give it ways to make the hallucination not the most plausible thing. I prefer to tell it that it can say "I don't know"