News for hackers. Stuff that matters.
Re:LLaMA Now Goes Faster on CPUs by sroussey on Monday April 01, 2024 @01:45PM (#39896847)
An LLM will always give the same output for the same input. It’s sorta like a random number generator that gives the same list of “random” numbers for the same seed. LLMs get a seed too.
Re:LLaMA Now Goes Faster on CPUs by latexr on Monday April 01, 2024 @04:46PM (#39899109)
That’s irrelevant for the matter. The person I replied to obviously did not have seeded responses in mind.