News for hackers. Stuff that matters.

A comment on The Need to Read. Parent comment

Re:The Need to Read by TekMol on Saturday November 26, 2022 @03:49AM (#33751101)
Is a "prompt prefix" a thing in GPT-3 or do you mean you combine that prefix with the text of the page into a prompt?
[ Parent | on HN ]
Re:The Need to Read by wskish on Saturday November 26, 2022 @03:55AM (#33751128)
We prepend the prompt prefix to the page text to create the actual model prompt. GPT doesn't have any such abstraction.
[ Parent | on HN ]
Re:The Need to Read by TekMol on Saturday November 26, 2022 @03:59AM (#33751149)
And GPT-3 remembers the prefix at the end of a long story and writes a summary?

That sounds very surprising to me. I would have strongly expected it continues the story.

[ Parent | on HN ]