News for hackers. Stuff that matters.
Re:LLaMA Now Goes Faster on CPUs by latexr on Monday April 01, 2024 @08:15AM (#39893299)
You can ask LLMs the same question and they might sometimes get it wrong and other times get it right. Having different answers is no indication that none of them is correct.

Furthermore, even if an LLM always gives the same answer to a question, there’s no guarantee the answer is correct.

https://en.wikipedia.org/wiki/Propaganda

https://en.wikipedia.org/wiki/Big_lie#Alleged_quotation

Re:LLaMA Now Goes Faster on CPUs by sroussey on Monday April 01, 2024 @01:45PM (#39896847)
An LLM will always give the same output for the same input. It’s sorta like a random number generator that gives the same list of “random” numbers for the same seed. LLMs get a seed too.
Re:LLaMA Now Goes Faster on CPUs by latexr on Monday April 01, 2024 @04:46PM (#39899109)
That’s irrelevant for the matter. The person I replied to obviously did not have seeded responses in mind.