News for hackers. Stuff that matters.
Re:Markov Chains Are the Original Language Models by cestith on Wednesday September 24, 2025 @12:39PM (#45362808)
Memory of the past implies the current state includes information about how the buffer got the way it is. I’m not defining anything in that way. I’m saying that if you have a buffer of N tokens, the next token N+1 can be chosen based on N tokens, not 1 token and not on the calculations or past state changes that went into creating the current state of the buffer.

There are no comments on this comment yet.