News for hackers. Stuff that matters.
Re:Using GPT-4 to measure the passage of time in fiction by jsight on Friday June 23, 2023 @10:53AM (#36447624)
> Not really. Nothing random about the output of LLMs. https://www.nature.com/articles/s41587-022-01618-2

I can see what you are getting at, but the underlying implementation of LLMs really is reliant on non-deterministic, random sampling of the underlying model. The random sampling is weighted to favor certain selections over others, but rare selections are possible.

Its intrinsically built on a degree of randomness. Though it is also unfair to say something like "produce random output" as the probabilities themselves make it less than fully random.

There are no comments on this comment yet.