News for hackers. Stuff that matters.
Re:Structured Output from LLMs (Without Reprompting!) by darkteflon on Monday July 17, 2023 @01:06AM (#36754368)
In response to your sister comment: the implementation we used was the naive one from LangChain (https://python.langchain.com/docs/modules/chains/additional/...). We've decomposed that to use as a starting point but early results are promising, yes, although it doesn't yet seem to be possible to get the necessary `logprobs` out of the GPT-4 API, so we're stuck with 3.5-turbo atm.

There are no comments on this comment yet.