Many SWE-bench-Passing PRs would not be merged

Re:Many SWE-bench-Passing PRs would not be merged by Kave0ne on Wednesday March 11, 2026 @11:05PM (#47345890)

Right, the raw material is there — but there's a gap between "data exists" and "agent has a working model of it." Reading git history on demand is retrieval; internalizing which patterns the team consistently rejects, which abstractions they've refactored away from twice, which reviewer will push back on X — that's a different thing.

The analogy is a new hire with full access to the wiki and Slack history vs. someone who's been on the team six months. The new hire can look things up; the veteran has already synthesized it into judgment that fires before they write a line. Agents currently operate like very fast new hires — great at retrieval, weak on the accumulated synthesis.

[ Parent | on HN ]

Re:Many SWE-bench-Passing PRs would not be merged by eru on Thursday March 12, 2026 @12:21AM (#47346407)

You are right that there's a difference. But you can tell the agent to ingest the whole thing once, and distill an approach in a much smaller (and human readable and reviewable) description perhaps? And then that can serve as the basis for the agent going forward.

So you don't have to retrieve the whole history all the time.

It's similar to telling your new hire to catch up on _all_ the slack history. Only that the agent will actually do so.

[ Parent | on HN ]