Re:In 27,280 coding agent runs, 64% of inference spend went ...
by chickensong on Tuesday November 17, 2026 @06:19PM
(#50539613)
The harness is what you make it, or not. The OP claiming all harnesses are simple loops is looking at it from a simple perspective. As soon as you start customizing or building a bespoke harness, YMMV.
Re:In 27,280 coding agent runs, 64% of inference spend went ...
by Edward40 on Tuesday November 17, 2026 @07:41PM
(#50540356)
I don't mean the harness, just the loop. Memory could be a part of the harness.
Re:In 27,280 coding agent runs, 64% of inference spend went ...
by chickensong on Tuesday November 17, 2026 @08:15PM
(#50540624)
Sorry, I misused OP there, was referring to @cpeth in this comment thread.
Thanks for your eval work, it seems like a tough area to measure!
That can make a huge difference, as evidenced by the agent swarms success at cracking maths.