LLM that can call multiple tool APIs with one request

Re:LLM that can call multiple tool APIs with one request by verdverm on Tuesday June 18, 2024 @05:09AM (#40715543)

I brought it up because popular frameworks are offering this type of agent or function out of the box

There is no "way that tools work"

You pass OpenAPI like schemas along with the prompt and you get back a JSON object. The rest is code and you can do anything you want with. The LLM is merely mapping from unstructured text onto a schema best it can, and we know they are imperfect.

[ Parent | on HN ]

Re:LLM that can call multiple tool APIs with one request by TZubiri on Tuesday June 18, 2024 @07:09PM (#40723047)

https://en.wikipedia.org/wiki/Robustness_principle

"be conservative in what you send, be liberal in what you accept"

LLM parses text into a list of parameters. You design your function such that it is safe regardless of what the parameters are.

[ Parent | on HN ]