News for hackers. Stuff that matters.
Re:Structured Output from LLMs (Without Reprompting!) by darkteflon on Monday July 17, 2023 @12:51AM (#36754313)
I'd never heard of LMQL before today, but it looks very nice. Do you have any experience building with it and, if so, would you be willing to comment on what it's like?
Re:Structured Output from LLMs (Without Reprompting!) by theblazehen on Monday July 17, 2023 @03:22AM (#36755122)
I did a POC project with it recently. The guidance on gpt-3.5-turbo and gpt-4 models isn't as functional as plain gpt-3. I found I had better results using https://github.com/piercefreeman/gpt-json and it doesn't require multiple calls to the API. Not as feature filled, but it may meet your needs
Re:Structured Output from LLMs (Without Reprompting!) by darkteflon on Monday July 17, 2023 @07:49AM (#36756959)
Thanks for the recommendation - gpt-json looks quite nice, actually - will check it out.