News for hackers. Stuff that matters.
Re:OpenAI to discontinue support for the Codex API by ilaksh on Tuesday March 21, 2023 @02:18AM (#35243052)
The problem that I saw with Codex is that it routinely bugs out and starts repeating something infinitely. And the model parameters can't stop that from happening.
Re:OpenAI to discontinue support for the Codex API by deskamess on Tuesday March 21, 2023 @08:57AM (#35245501)
I see something similar with ChatGPT too... it seems to forget a previous constraints and jumps to the generic. In my example, I was trying to generate an ffmpeg command line that given a source file will, during transcode, generate stereo audio even if the source file had no audio (so basically output a blank audio stream). It kept using 0:a in the complex filter and I would ask it what would happen if there was no audio stream in the input file? It would actually correct itself but something else would break in the fix. I would point out something else was wrong and it would fix that but reintroduce 0:a.
Re:OpenAI to discontinue support for the Codex API by eldenring on Tuesday March 21, 2023 @09:57AM (#35246173)
Maybe the output was long enough that the context window would miss your previous prompts?
Re:OpenAI to discontinue support for the Codex API by clonhero on Monday March 27, 2023 @10:26AM (#35327058)
I'm late, but the model can remember 4000 tokens, which according to openai is about 3000 words