Re:Many SWE-bench-Passing PRs would not be merged
by catlifeonmars on Thursday March 12, 2026 @08:46AM
(#47349827)
I wonder if it helps at all to first tell the agent to write the APIs/function signatures, then second tell the agent to implement them.
It is important to start a new chat so the model is not stuck in its previous mindset, and it is beneficial to have tests to verify that the simplified code still works as it did before.
Telling the model to generate concise code did not work for me, because LLMs do not know beforehand what they are going to write, so they are rarely able to refactor existing code to break out common functionality into reusable functions. We might get there eventually. Thinking models are a bit better at it. But we are not quite there yet.