News for hackers. Stuff that matters.
Re:DeepSeek-R1 by baq on Tuesday January 21, 2025 @01:26AM (#42777182)
The problem is it can’t remember what it hasn’t written but the end result still makes sense, so there has to be some goal after parsing the initial context that the tokens are emitted towards to. This means there’s nothing stopping it from producing an explanation, it might be in there from the very start.
Re:DeepSeek-R1 by svachalek on Tuesday January 21, 2025 @10:20AM (#42781059)
There's no goal. The tokens are computed one at a time from all the previous tokens.
Re:DeepSeek-R1 by baq on Tuesday January 21, 2025 @11:33AM (#42782029)
One is orthogonal to the other.
Re:DeepSeek-R1 by gpm on Tuesday January 21, 2025 @02:25PM (#42784221)
Not one goal though, but a set of goals. Otherwise the random sampling of tokens wouldn't result in it outputting meaningfully different jokes.

I also think it's safe to assume that the set of goals isn't fully resolved, but it's harder to "prove" that.