News for hackers. Stuff that matters.
Re:New tools for building agents by sippeangelo on Tuesday March 11, 2025 @07:54PM (#43338465)
I mirror this sentiment. Even their "function calling" abstraction still hallucinates parameters and schema, and the JSON schema itself is clearly way too verbose and breaks down completely if you feed it anything more complex than 5 very simple function calls. This just seems to build upon their already broken black box abstractions and isn't useful for any real world applications, but it's helpful for getting small proof-of-concept apps going, I guess...
Re:New tools for building agents by swyx on Wednesday March 12, 2025 @03:30AM (#43340693)
> Even their "function calling" abstraction still hallucinates parameters and schema

huh? sample code please? this should not be true since Structured Outputs came out - literally prevented from generating invalid json

(more: https://www.latent.space/p/openai-api-and-o1)

Re:New tools for building agents by amitness on Wednesday March 12, 2025 @04:52AM (#43341078)
It's not enabled by default for their function calling API. So, hallucination is possible.

You have to set 'strict' to True manually to use the same grammar-based sampling they use for structured outputs.

https://platform.openai.com/docs/guides/function-calling?api...