Re:LLM that can call multiple tool APIs with one request
by TZubiri on Tuesday June 18, 2024 @04:45PM
(#40722056)
Correct, by "it" I was referring specifically to the "Tools" functionality that is the subject of the linked article.
Tools DON'T generate sql queries, they generate function calls. Of course you can hack it to output sql queries, you can always hack something beyond its intended design purpose, but it's not what it's supposed to be doing.
Re: permissions, nothing new here, give your LLM agent the permissions of a Junior DBA.
They are actually quite flexible and you can do anything you want. You supply the LLM with the function names and possible args. I can easily define "sql(query: string)" as a flexible SQL function the LLM can use
re: permissions, as soon as you have write permissions, you have dangerous potential. LLMs are not reliable enough, nor are humans, which is why we use code review.