News for hackers. Stuff that matters.
Re:Markov Chains Are the Original Language Models by drdeca on Wednesday September 24, 2025 @01:42AM (#45356702)
I think there’s an equivocation being accidentally made between n-gram models, and Markov processes, because “Markov chain” is used to mean both things.

N-gram models are not useful in many of the ways LLMs are.

N-gram models are very limited.

On the other hand, basically any process can be considered a Markov process if you make the state include enough.

So, calling both the very-limited n-gram models and the nearly-unlimited Markov processes, by the same name “Markov chain” is just, super confusing.

There are no comments on this comment yet.