That is called caching, which is used to save computation. But only tokens are enough to calculate next token and state could be recomputed.