OpenAI’s policies hinder reproducible research on language models

Re:OpenAI’s policies hinder reproducible research on languag... by lionkor on Thursday March 23, 2023 @04:39AM (#35271876)

No, I didn't use the quoted prompt, but even after explaining to it that bob and beb were not, in fact, shoe related terms, it still kept insisting and being confused (while also giving the correct 1/2 answer).

It can do it, but its not deterministic, and it doesnt really do it well. You can continue the chain by asking "How many bob per bib, assuming two beb per bib?", and see if it chokes then. It sometimes does, sometimes doesnt.

[ Parent | on HN ]

Re:OpenAI’s policies hinder reproducible research on languag... by ogogmad on Thursday March 23, 2023 @04:53AM (#35271973)

GPT-4:

   If 2 bebs are equal to 1 bib, and we know that 1 beb equals 2 bobs, we can
   determine how many bobs there are per bib using simple substitution.
   
   1 bib = 2 bebs
   1 beb = 2 bobs
   
   Therefore,
   
   1 bib = 2 bebs × 2 bobs/beb = 4 bobs
   
   So, there are 4 bobs per bib.

[ Parent | on HN ]

Re:OpenAI’s policies hinder reproducible research on languag... by Tostino on Thursday March 23, 2023 @01:48PM (#35278552)

You do realize that the current implementations get their context polluted by your prior conversation, right?

[ Parent | on HN ]