My primitive understanding is that we approximate a Markovian approach and indirectly model the transition probabilities just by working through tokens.