News for hackers. Stuff that matters.
Re:Andrej Karpathy talks about "Claws" by dwood_dev on Saturday February 21, 2026 @09:23PM (#47107482)
It seems to me like it would be a rather useful exercise to have the smaller model make the routing decision, and below certain confidence thresholds, it sends it to a larger model anyways. Then have the larger model evaluate that choice and perhaps refine instructions.
Re:Andrej Karpathy talks about "Claws" by akssassin907 on Sunday February 22, 2026 @04:20PM (#47114798)
That's a cleaner implementation than what I described. Small model as meta-router: classify locally, escalate only when confidence is low. The self-evaluation loop you're suggesting would add a quality layer without much overhead — the large model's judgment of its own routing is itself a useful signal. Haven't shipped that yet but it's on the list.