News for hackers. Stuff that matters.
Re:Understanding the Limitations of Mathematical Reasoning i... by int_19h on Friday October 11, 2024 @04:42PM (#41813521)
The actual output of an LLM for any particular round of inference is always probabilities, so one could argue that it is literally the opposite.

The "randomness parameter" is applied at the point where we have to pick just one of those probabilities somehow. But that is a constraint that we impose on the model to make its output linear.

There are no comments on this comment yet.