News for hackers. Stuff that matters.
Re:You only need the frontier model for one single edit by ursuscamp on Tuesday July 21, 2026 @09:34AM (#48992153)
Can someone explain to me the difference between this approach and using planning with a larger model, then just switching to a small model for implementation without clearing the context? I understand that it specifically does the first edit as well either way the larger model. Is there some other difference I am missing here?
Re:You only need the frontier model for one single edit by trash_cat on Tuesday July 21, 2026 @11:41AM (#48993814)
When a frontier makes a succesfull edit based on the plan that it made, it leaves an procedural trace in turn biases the NEXT model, low cost model, straight into procedural action. The cheaper model doesn't need to reread everything again because it has enough information from the frontier model to complete the task. A simple "plan" of what needs to be done does not carry this information.
Re:You only need the frontier model for one single edit by actionfromafar on Tuesday July 21, 2026 @09:36AM (#48992172)
If I understand correctly, switching to a small model makes the small model read the context again.