News for hackers. Stuff that matters.
Re:Collapse of Self-Trained Language Models by epr on Wednesday April 17, 2024 @04:57PM (#40069981)
One of the tokens represents stopping. If you sample stop from the probability distribution instead of a normal text token, then you stop autoregressive sampling.

There are no comments on this comment yet.