News for hackers. Stuff that matters.
Re:OpenAI DevDay, Opening Keynote Livestream [video] by CSMastermind on Monday November 06, 2023 @01:39PM (#38166783)
Honestly? The JSON API they announced is the most exciting thing for me so far.
Re:OpenAI DevDay, Opening Keynote Livestream [video] by rocgf on Monday November 06, 2023 @02:02PM (#38167150)
Not saying it's not useful, but you can achieve the same result consistently with just a few extra tokens in the prompt.
Re:OpenAI DevDay, Opening Keynote Livestream [video] by CSMastermind on Monday November 06, 2023 @02:35PM (#38167688)
That's what I do today and I still occasionally see failures that are extremely annoying because there's nothing I can do but resend the request to the API.

It seems like you'd need finetuning to make it truly consistent, which is what I'm assuming they did.

Re:OpenAI DevDay, Opening Keynote Livestream [video] by rocgf on Monday November 06, 2023 @02:47PM (#38167881)
Yes, so that is the outcome that I would imagine as well - basically it will never fail.

However, I have a virtually 100% success rate with the JSON feature in Langchain.