News for hackers. Stuff that matters.
Re:Gemini 4 Neon by drivebyhooting on Wednesday November 18, 2026 @05:11PM (#50552969)
What we need is a model that automatically delegates intelligently (via RL and benchmaxxing?) so I can be freed of this burden.
Re:Gemini 4 Neon by iamdelirium on Wednesday November 18, 2026 @05:15PM (#50553020)
Antigravity has a Orchestrator model that does this.
Re:Gemini 4 Neon by refulgentis on Wednesday November 18, 2026 @05:22PM (#50553115)
There's stuff that does this and I've put a substantial amount of time last couple months looking into it, unfortunately you always, always, end up at chicken-and-egg problems.

It's really frustrating to describe. Easiest is you can't score on just the prompt, you need the full context. Ex. "Solve Fermat's last theorem" initial prompt then "continue" followup prompt. Which gets you back in the tarpit of "if I have to pay a model to do an inference run on context, then, the context is cached and I should continue using that model."

The vision of another model thats RL maxx'd on knowing how to delegate has a few problems. One, we can observe externally, it died/didn't work even at OpenAI's scale and willingness to make it work, i.e. the...GPT-5.0? IIRC...router that silently went away. The other, if such a model was built, it'd also be good at regulating it's own thinking enough that it'd naturally use less tokens.

In practice, the frontier hackers have settled on a decision model (i.e. Jev) x calibrating effort level or choosing from a set of models x reasoning effort tuples they specify rules for choosing in their Jev prompt. My guess is this stays stable and the only real choice.

Re:Gemini 4 Neon by baoooooooooooo on Wednesday November 18, 2026 @05:40PM (#50553365)
This comment always comes up but isn’t this literally irreducibly complex in the sense of Kolmogorov complexity?

I’m out of my depth here but it does seem prompts have a “smell” to their complexity that means we can use a classifier to mate them to a model with better success than random noise, but still don’t essentially all of the savings associated with systems like this just come because there is some “complexity arbitrage” where there is enough of a token cost differential between models that you always save money by trying the cheap model first and then trying a hard model if it turns out to be hard?

Re:Gemini 4 Neon by nicoburns on Wednesday November 18, 2026 @05:48PM (#50553470)
This is being done at the layer above. "routing" is the term to google.
Re:Gemini 4 Neon by drivebyhooting on Wednesday November 18, 2026 @06:48PM (#50553998)
Routing at the prompt level seems naive. How is that better than a janky classifier.

What I want is a deeply introspective model that knows to take a step back and call in for aid.

Re:Gemini 4 Neon by nicoburns on Wednesday November 18, 2026 @06:51PM (#50554027)
It's being done at the harness level. It's still a model making the call.
Re:Gemini 4 Neon by canadiantim on Wednesday November 18, 2026 @10:48PM (#50555844)
Aren't people using jev or similar for decision-making like this?