News for hackers. Stuff that matters.
Re:Training and Aligning LLMs with RLHF and RLHF Alternatives by Salgat on Monday September 11, 2023 @11:42AM (#37468959)
So by your definition of creativity, the LLM is always being creative because it's always using probability to determine the next word (it's not just spitting out facts from a database). Hallucination is just when that prediction, or creativity as you call it, is wrong.

There are no comments on this comment yet.