Re:AI Prompt Engineering Is Dead
by msp26 on Wednesday March 06, 2024 @11:49AM
(#39617850)
nono, the same thing happens with OpenAI's JSON mode and function calling. It does output parsable JSON very reliably but it comes out mangled with a bunch of whitespace sometimes.
GPT-4-turbo's output context window is limited to 4096 so fixing this is relevant. You can use logit_bias for it.
GPT-4-turbo's output context window is limited to 4096 so fixing this is relevant. You can use logit_bias for it.