News for hackers. Stuff that matters.
Re:The Need to Read by wskish on Saturday November 26, 2022 @03:55AM (#33751128)
We prepend the prompt prefix to the page text to create the actual model prompt. GPT doesn't have any such abstraction.
Re:The Need to Read by TekMol on Saturday November 26, 2022 @03:59AM (#33751149)
And GPT-3 remembers the prefix at the end of a long story and writes a summary?

That sounds very surprising to me. I would have strongly expected it continues the story.