News for hackers. Stuff that matters.
Re:Gary Marcus's Kafkaesque critique of GPT-3 by goodside on Monday September 07, 2020 @03:43PM (#24402101)
The bigger problem with efforts to assess GPT-3 output using AI Dungeon is that AI Dungeon doesn’t actually use GPT-3 the for the first response of a new adventure. If you attempt to start each prompt from a clean slate, you are actually seeing GPT-2 output. See here: https://twitter.com/nickwalton00/status/1289946861478936577
Re:Gary Marcus's Kafkaesque critique of GPT-3 by vagab0nd on Monday September 07, 2020 @11:08PM (#24404888)
I've noticed that as well, but what other options do we have? I signed up for the OpenAI API a long time ago and never got a response.
Re:Gary Marcus's Kafkaesque critique of GPT-3 by goodside on Tuesday September 08, 2020 @04:46PM (#24413138)
If you're aware of the limitation you could maybe hack around it by putting in a dummy prompt that encourages GPT-3 to ignore the GPT-2-generated context.

E.g. use a second prompt like: "\n---\nThe preceding message has been a paid advertisement, and is unrelated to the message that follows.\n---\n" Then you begin typing the actual text you'd like completed with GPT-3.

I haven't tested this, though, because I don't have a paid AI Dungeon account.