>>> who won the 1986 Cricket World Cup
India
>>> who won the 1986 Cricket World Cup
Australia
>>> who won the 1986 Cricket World Cup
New Zealand
>>> who won the 1986 Cricket World Cup
West Indies
>>> who won the 1986 Cricket World Cup
England
Which proves GP's point about hallucinations, though none of those are> Brooklyn Nets won the 1986 Cricket World Cup by scoring 46 yards in only 3 frames
LLM's hallucinations are insidous because they have the ring of truth around them. yards and frames aren't cricket terms, so we're off to the races with them.
This makes sense. If you interact with a language model and it says something wrong it is your fault
It's like how you have to set x264 to the anime tuning or the film tuning depending on what you run it on.
Furthermore, even if an LLM always gives the same answer to a question, there’s no guarantee the answer is correct.
For fact retrieval you need to use temperature 0.
If you don't get the right facts then try 34b, 70b, Mixtral, Falcon 180b, or another highly ranked one that has come out recently like DBRX.
> Australia won the 1987 Cricket World Cup. The 1986 date is incorrect; there was no Cricket World Cup in 1986. The tournament took place in 1987, and Australia defeated England in the final to win their first title.
https://chat.openai.com/share/e9360faa-1157-4806-80ea-563489...
I'm no cricket fan, so someone will have to correct Wikipedia if that's wrong.
If you want to point out that LLMs hallucinate, you might want to speak plainly and just come out and say it, or at least give a real world example and not one where it didn't.