News for hackers. Stuff that matters.
Re:Structured Outputs Create False Confidence by ramraj07 on Sunday December 21, 2025 @02:30PM (#46347537)
Isn't it better to put it in an agent loop, with the structured output json just specified as a tool? The function call can then just return a summary of the parsed input. We can add in the system prompt a validation step to ask the llm to verify it has provided inputs correctly. This will allow the llm itself to self reflect and correct if needed.

There are no comments on this comment yet.