News for hackers. Stuff that matters.

A comment on Kor: Extract structured data using LLMs.

Re:Kor: Extract structured data using LLMs by anotherpaulg on Monday June 26, 2023 @03:55PM (#36484948)
Does this take advantage of the new OpenAI functions api? From a quick look, I can't find any indication that it does. Although I find it tricky to disentangle the langchain abstractions, so I might be missing it. Kor's last release predates the announcement of OpenAI functions, so probably not.

Seems like this is now best done via functions, if you're using OpenAI's models? They call out "extracting structured data from text" as a key use case in their announcement.

https://openai.com/blog/function-calling-and-other-api-updat...

[ Parent | on HN ]
Re:Kor: Extract structured data using LLMs by BorisWilhelms on Monday June 26, 2023 @04:11PM (#36485164)
No, it is not using openai functions. Since it is on top of langchain it uses the LLM abstraction of it and it can be used with other models as well.
[ Parent | on HN ]
Re:Kor: Extract structured data using LLMs by anotherpaulg on Monday June 26, 2023 @05:47PM (#36486309)
Yup, the flexibility of running against any model via langchain is super helpful.
[ Parent | on HN ]
Re:Kor: Extract structured data using LLMs by contravariant on Monday June 26, 2023 @08:06PM (#36487494)
Are there any useful alternative models though? Most I've found weren't particularly good at following instructions or using tools in the way langchain provides them.
[ Parent | on HN ]
Re:Kor: Extract structured data using LLMs by reissbaker on Tuesday June 27, 2023 @01:11AM (#36489135)
FYI, the upcoming version of gpt4 does considerably worse emulating function calls / generating code-like strings, but gets better again if you switch to the function call API: https://twitter.com/reissbaker/status/1671361372092010497

(My guess is the same is true of gpt-3.5, although I haven't tested it.)

That being said, Langchain has a nearly drop-in replacement if you want to start using the function call API: https://python.langchain.com/docs/modules/agents/agent_types...

[ Parent | on HN ]