Re:Apple has new Mac app coming to make running local AI mod...
by ThePinion on Wednesday November 11, 2026 @02:56PM
(#50457812)
I really appreciate the response, that gives me good ideas on where to start going about all this. It seems so silly to have API models doing so much file exploration and tool calling.
I saw this a while ago which shows small models and focuses on the ones that make the least (or no) wrong tool calls and it got me intrigued on the possibilities in this realm, especially for lower end devices. https://github.com/MikeVeerman/tool-calling-benchmark
There was a task manager which was given context of the tech stack so it could split the incoming requests. Then branch out the tasks to appropriate agents. Combine the generated code - this was a file/module/import manager.
The other way is let tiny models (again I would use agents for different use cases) do the busy work - tool calling, finding evidence, etc. I usually setup agents to re-write tool call history and create fresh API requests without using multi-turn chat with tool call history.