Re:Introducing Structured Outputs in the API
by agtech_andy on Tuesday August 06, 2024 @04:16PM
(#41174869)
I have had a lot of success using BoundaryML (https://www.boundaryml.com/) for this. They have also been super responsive for any of my questions.
[ Parent
| on HN ]
Re:Introducing Structured Outputs in the API
by aaronvg on Tuesday August 06, 2024 @05:15PM
(#41175461)
thanks for the shoutout, we benchmarked our approach against other function-calling techniques and we've been able to beat all other approaches every time (even by 8%!) just by getting better at parsing the data and representing schemas with less tokens using type definitions instead of json schema.
You can take a look at our BFCL results on that site or the github: https://github.com/BoundaryML/baml
We'll be publishing our comparison against OpenAI structured outputs in the next 2 days, and a deeper dive into our results, but we aim to include this kind of constrained generation as a capability in the BAML DSL anyway longterm!