News for hackers. Stuff that matters.
Re:LLM Hallucinations: why they occur and how to avoid them by worldofideas123 on Wednesday May 03, 2023 @02:03AM (#35798584)
I think a way of avoiding hallucinations is using the same LLM with different values of the temperature parameter. Hallucinations, by their own nature, are prone to have great variance, so a change in temperature implies a big change in the story of facts inferred by the LLM, so it seems a main way of fighting hallucinations is checking coherence of the LLM using different values of temperature. So the probability of hallucinations is just the d(story)/d(temperature). This suggest to investigate how the embedding distance of small episodes change with temperature.
Re:LLM Hallucinations: why they occur and how to avoid them by gbasin on Thursday May 04, 2023 @09:51AM (#35815322)
Yes this feels analogous to ensembling which can help measure variance, also