News for hackers. Stuff that matters.
Re:I Don't Know, Sorry by kaelinl on Thursday November 30, 2023 @03:13AM (#38471034)
How many tokens was that before it diverged from your original request? If it filled the context window, the original prompt would no longer be available to the model and it would start predicting just based on the repeated word. That certainly looks like what's happened here, although I haven't checked what model context size you used or how long the response is.
Re:I Don't Know, Sorry by warkanlock on Thursday November 30, 2023 @03:31AM (#38471154)
None. This was the original request.
Re:I Don't Know, Sorry by kaelinl on Thursday November 30, 2023 @11:56AM (#38475818)
The question is not how many prior messages there were in the conversation. That's irrelevant for context window purposes. The question is how many tokens there are between the prompt and the point where the reply breaks down.
Re:I Don't Know, Sorry by Kiro on Thursday November 30, 2023 @02:51AM (#38470848)
I presume you were inspired by this that was posted yesterday: https://news.ycombinator.com/item?id=38458683
Re:I Don't Know, Sorry by hilux on Thursday November 30, 2023 @02:29AM (#38470725)
The 21st century version of Spock commanding the computer to calculate the digits of pi.
Re:I Don't Know, Sorry by warkanlock on Thursday November 30, 2023 @01:40AM (#38470429)
This is a real conversation I just had with ChatGPT. A strange text appeared near the end of the prompt
Re:I Don't Know, Sorry by nittanymount on Thursday November 30, 2023 @02:08AM (#38470594)
nice
Re:I Don't Know, Sorry by MountainMan1312 on Thursday November 30, 2023 @08:44AM (#38473429)
You cannot possibly be a burden on the company, the company is inherently a burden on you by it's very nature.
Re:I Don't Know, Sorry by Thoreandan on Thursday November 30, 2023 @12:17PM (#38476070)
Neither Firefox nor Chrome (desktop) can successfully save full-sized screenshots of this.

I wonder what their trick is.