Re:Native JSON Output from GPT-4
by behnamoh on Wednesday June 14, 2023 @04:34PM
(#36332210)
What's the implication of this new change for Microsoft Guidance, LMQL, Langchain, etc.? It looks like much of their functionality (controlling model output) just became obsolete. Am I missing something?
[ Parent
| on HN ]
Re:Native JSON Output from GPT-4
by lbeurerkellner on Wednesday June 14, 2023 @04:45PM
(#36332378)
If anything this removes a major roadblock for libraries/languages that want to employ LLM calls as a primitive, no? Although, I fear the vendor lock-in intensifies here, also given how restrictive and specific the Chat API.
Either way, as part of the LMQL team, I am actually pretty excited about this, also with respect to what we want to build going forward. This makes language model programming much easier.
`Although, I fear the vendor lock-in intensifies here, also given how restrictive and specific the Chat API.`
Eh, would be pretty easy to write a wrapper that takes a functions-like JSON Schema object and interpolates it into a traditional "You MUST return ONLY JSON in the following format:" prompt snippet.
Re:Native JSON Output from GPT-4
by londons_explore on Wednesday June 14, 2023 @06:09PM
(#36333468)
> Although, I fear the vendor lock-in intensifies here,
The openAI API is super simple - any other vendor is free to copy it, and I'm sure many will.
Re:Native JSON Output from GPT-4
by neuronexmachina on Wednesday June 14, 2023 @07:29PM
(#36334328)
Langchain added support for `function_call` args yesterday:
* https://github.com/hwchase17/langchain/pull/6099/files
* https://github.com/hwchase17/langchain/issues/6104
IMHO, this should make Langchain much easier and less chaotic to use.
It's only been added to the OpenAI interface. Function calling is really useful when used with agents. To include that to agents would require some redesign as the tool instructions should be removed from the prompt templates in favor of function definitions in the API request. The response parsing code would also be affected.
I just hope they won't come up with yet another agent type.
Re:Native JSON Output from GPT-4
by neuronexmachina on Thursday June 15, 2023 @02:52AM
(#36337245)