Re:Lawyer cited 6 fake cases made up by ChatGPT; judge calls...
by seba_dos1 on Wednesday May 31, 2023 @06:25AM
(#36136656)
Yes, obviously...? A piece of paper holds more than a single word as well. That piece of paper is the context in this analogy.
It still generates one token at a time and can't backtrack afterwards.
I'm pretty sure GPT-4's context window is bigger than '1 token'.