News for hackers. Stuff that matters.
Re:LLaMA Now Goes Faster on CPUs by beefnugs on Monday April 01, 2024 @03:13AM (#39891587)
Actually isn't this good? It means we can run something multiple times to prove itself a bad answer?
Re:LLaMA Now Goes Faster on CPUs by latexr on Monday April 01, 2024 @08:15AM (#39893299)
You can ask LLMs the same question and they might sometimes get it wrong and other times get it right. Having different answers is no indication that none of them is correct.

Furthermore, even if an LLM always gives the same answer to a question, there’s no guarantee the answer is correct.

https://en.wikipedia.org/wiki/Propaganda

https://en.wikipedia.org/wiki/Big_lie#Alleged_quotation

Re:LLaMA Now Goes Faster on CPUs by sroussey on Monday April 01, 2024 @01:45PM (#39896847)
An LLM will always give the same output for the same input. It’s sorta like a random number generator that gives the same list of “random” numbers for the same seed. LLMs get a seed too.
Re:LLaMA Now Goes Faster on CPUs by latexr on Monday April 01, 2024 @04:46PM (#39899109)
That’s irrelevant for the matter. The person I replied to obviously did not have seeded responses in mind.
Re:LLaMA Now Goes Faster on CPUs by saagarjha on Tuesday April 02, 2024 @11:56PM (#39913465)
It can tell you if the answer is wrong, but it can never tell you if the answer is right.