News for hackers. Stuff that matters.
Re:Native JSON Output from GPT-4 by freezed88 on Wednesday June 14, 2023 @07:48PM (#36334507)
100%, if the API itself can choose to call a function or an LLM, then it's way easier to build any agent loop without extensive prompt engineering + worrying about errors.

Tweeted about it here as well: https://twitter.com/jerryjliu0/status/1668994580396621827?s=...

Re:Native JSON Output from GPT-4 by bel423 on Wednesday June 14, 2023 @08:39PM (#36334917)
You still have to worry about errors. You will probably have to add an error handler function that it can call out to. Otherwise the LLM will hallucinate a valid output regardless of the input. You want it to be able to throw an error and say I could produce the output given this format.