News for hackers. Stuff that matters.
Re:New tools for building agents by swyx on Wednesday March 12, 2025 @03:30AM (#43340693)
> Even their "function calling" abstraction still hallucinates parameters and schema

huh? sample code please? this should not be true since Structured Outputs came out - literally prevented from generating invalid json

(more: https://www.latent.space/p/openai-api-and-o1)

Re:New tools for building agents by amitness on Wednesday March 12, 2025 @04:52AM (#43341078)
It's not enabled by default for their function calling API. So, hallucination is possible.

You have to set 'strict' to True manually to use the same grammar-based sampling they use for structured outputs.

https://platform.openai.com/docs/guides/function-calling?api...