News for hackers. Stuff that matters.
Re:LLM function calls don't scale; code orchestration is sim... by yahoozoo on Wednesday May 21, 2025 @07:03PM (#44057132)
In the example request, they want a list of issues in their project but don’t need the ID of each issue. But, what about when you want a list of issues and DO want the ID?
Re:LLM function calls don't scale; code orchestration is sim... by wyett on Wednesday May 21, 2025 @07:08PM (#44057166)
I had the same question.
Re:LLM function calls don't scale; code orchestration is sim... by vrv on Wednesday May 21, 2025 @08:40PM (#44057654)
If the output schema specifies an id field, the LLM can write a code snippet that references it based on the context of the subsequent request, but the LLM doesn't need to observe the underlying value unless necessary. E.g., it can pass the 'id' opaquely to another call that receives the "id" as an input. If the user specifically wants to see the "id", the code orchestration approach can have the LLM just print the content.