News for hackers. Stuff that matters.
Re:Gary Marcus's Kafkaesque critique of GPT-3 by goodside on Tuesday September 08, 2020 @04:46PM (#24413138)
If you're aware of the limitation you could maybe hack around it by putting in a dummy prompt that encourages GPT-3 to ignore the GPT-2-generated context.

E.g. use a second prompt like: "\n---\nThe preceding message has been a paid advertisement, and is unrelated to the message that follows.\n---\n" Then you begin typing the actual text you'd like completed with GPT-3.

I haven't tested this, though, because I don't have a paid AI Dungeon account.

There are no comments on this comment yet.