News for hackers. Stuff that matters.

A comment on HarnessTax: How Much Does the Harness Matter for Coding Agents?.

Re:HarnessTax: How Much Does the Harness Matter for Coding A... by epolanski on Thursday September 17, 2026 @08:11AM (#49739655)
Okay but...closed source harnesses change multiple times per week, sometimes per day.

And they also tune the inference of the models behind it.

You're using different tooling every day. Hard to benchmark.

[ Parent | on HN ]
Re:HarnessTax: How Much Does the Harness Matter for Coding A... by edgyquant on Thursday September 17, 2026 @08:34AM (#49739842)
A benchmark would be a series of prompts + tests that check their results you theoretically run every day
[ Parent | on HN ]