There are a lot of ways to do this if you stop using Big Ai harnesses that make it difficult to use models besides theirs.
Ps: as you won't use your proxy to distill or alter claudecode requests to anthropic you should be compliant with anthropic rules.
Both are, I think, valid options. Depends on the workflow you're looking for.
So with the gdrive app for my OS it just looks like a local file path. Had the local agent learn to parse it.
I still prompt in AI studio direct as needed; local agents see the log change but cannot push back to Gemini their result.
Few reasons:
AI Studio is available where ever via browser, no VS Code or my usual vim setup to miss. I can switch between projects there as an idea hits and the agent switches up the local repo path and session history.
AI studio can search web already so my agent is less complicated with addons in general
Also using AI Studio between local agent turns has been my "human in the middle" approach; to have an explicit gap in the process and check each turn.
I only have a 24GB 3090 most models also take longer locally and I never hit the free tier limits with Gemini :D
Though the latest Meta model is twice as fast at 30B for me as other similar size models. 1-2 hour code gen and QA of build errors is now 30-50 minutes to parse latest changes from Gemini and get a successful build. The Meta model is pretty great at "fill in the middle" from a well structured plan.
Overall this loop feels like a normal workday pace. I freelance so I have a lot more say over that.
Claude will write some scripts to call the LLM API and use it like any other tool.
I haven't found a pressing need for anything more complex than that. My multi-agent setups tend to be a pile of bespoke scripts per project anyway, an MCP server is only gonna get in the way. But I suppose this is because I self-host the models, if you're using OpenRouter or whatever it may need more complexity than a curl call to an unauthenticated port
At this point if I could do anything with zero effort or time, I would get Opus 5.5 to make a grand scheme, handoff to the local model, and give it ability to reach out to Opus again.
That way you can do old school intent matching and rule-based bots that work super well, and only shell out for deeper work.
Smart agent to orchestrate cheaper agents for labour.
Dumber agents to be very explicit about asking smarter agents for requests that require deep information.
This is a thing - the SOTA models really light up the more information you can provide them, and humans are too lazy / incapable of doing that in every prompt.
Entirely depends on what you are trying to do.
What's the best method to have a 'smart' agent just.. ask itslef?
Asking Claude to make prompts is like a Math teacher stuck working at a cafe about Math problem, the just light up.
They are very good at at it.
You may use https://github.com/pingdotgg/t3code as a wrapper above claide/codex/pi/... harnesses, or a proxy below (forgot which one, as agent what theo uses for balancing multiple claude subs)
I use codex/claude code all day every day and built an MCP that allow them to use each other as sub-agents.
I will not allow claude code to touch my code with any design changes without codex auditing it, and visa versa.
I believe this is the case merely because they are different models that will provide varied perspectives, and smart enough to identify issues on each other's work.
I'm not sure if there's research to back this up but I think it's fairly obvious, and also FYI diminishing marginal return - I'm not sure if a '3rd perspective' would be worth it in most cases.
Not sure it’s the best approach but it has improved results.
But there are definitely cases.
GPT Pro is an absolutely spectacular model, that almost cannot be used without 'prompt help'. Or rather, it can only be effectively leveraged by very intricate prompting, which requires the help of another agent.
I typically use Claude Code to write prompts for GPT Pro , and cut and paste the prompt in, and let GPT Pro work for 20 minutes, then take the response back to Claude Code and work with Opus to consider the results.
Opus is 'dumber' (nominally) then GPT Pro.
It's branded as a separate model, but really it's like an 'ultrathinking' mode of OAI's model.
The details are not public but it's parallel test time compute and multi search, aka the model reasons along different vectors and compares answers.
If 'feels like' a smarter model, even though I'm pretty sure it's a synthetic variation of Astra.
It is by far the 'smartest model' if you were to benchmark it, and many of OAIs released were based on this.
There are few or no benchmark scores on it because it's not suitable for harness testing or coding, it's almost designed to be 'one shot' or 'few shot'.
It takes 8-25 to answer, and if you give it a sufficiently sophisticated prompt, it will think for 1 hour.
It requires OAI's 'pro' account aka the $200/month one.
It's the best open secret in AI, I can't recommend it enough.
* Orchestrator: Opus 5.5
* Feature lead: GPT 6.1 Sol
* Worker: Muse Spark 1.3 Contributor
As long as you have an appropriate project and sandbox for Muse Spark it's the real secret sauce for my setup and it's dirt cheap on OpenCode Go.GPT 6.1 Sol is surprisingly efficient too, I've been impressed with it.
My orchestration skill setup is https://github.com/beefsack/processed-beef/
Does anyone have any evidence that having the most powerful model being the orchestrator, and other sub agents being progressively less powerful, is optimal? Is this just common sense or it has been measured somehow?
For me it could be that this scheme may make the code itself poorly written, verbose or faulty
In my setup, the orchestrator also drives a lot of the design and planning, and the less capable models get inputs from the more capable models by responding back up the chain. The more capable models also review everything that is produced by the cheaper models.
I've also had systems that invert this and allow cheaper models to call out to more capable models when they need to, but in my observation I found them quite bad at knowing even when to call out and I find wrapping the cheap models a bit more reliable in that problems tend to get caught before they bubble up to the user.
With that said, there is evidence that we recently crossed over a line for 'best practices' when it comes to systems of multiple agents. Comparing the shapes of 'n agents working collaboratively' vs '1 agent spawning n agents to handle distinct work', Opus 5.5[1] and Opus 5[4] performs better with the former, Sonnet 5.5[2] and Opus 4.8[3] performs better with the ladder.
[1] https://www-cdn.anthropic.com/fc1b44717c85dc068bc6ba50242199...
[2] https://assets.claude.com/870c8f525702625d2c62fc6dd04c857e32...
[3] https://assets.claude.com/0f0c97ad20d8005706296bd92aa1c27c6b...
[4] https://assets.claude.com/ceaf5c7ff2783855203fde8208ec311252...
I'd be interested to know what the difference in cost is in this setup on building a complex feature vs using Opus directly.