News for hackers. Stuff that matters.
Re:Lawyer cited 6 fake cases made up by ChatGPT; judge calls... by dmd on Tuesday May 30, 2023 @08:59PM (#36133238)
> You should expect similar results as if it was bunch of people passing a single piece of paper to each other, each writing a single word on it, not communicating with each other in any other way and trying their best to come up with coherent result.

I'm pretty sure GPT-4's context window is bigger than '1 token'.

Re:Lawyer cited 6 fake cases made up by ChatGPT; judge calls... by seba_dos1 on Wednesday May 31, 2023 @06:25AM (#36136656)
Yes, obviously...? A piece of paper holds more than a single word as well. That piece of paper is the context in this analogy.

It still generates one token at a time and can't backtrack afterwards.