News for hackers. Stuff that matters.
Re:We Tested Coding Agent Harnesses. Thinking Harder Beat Al... by brdo on Wednesday November 04, 2026 @03:58PM (#50371430)
Skills and plugins have become less and less important in the ecosystems. Superhuman seems to be the outlier in both this benchmark and empirical evidence.

The challenge is improving performance while decreasing cost. There are many token condensers and model routers that attempt to do decrease cost, but they end up sacrificing performance.

Re:We Tested Coding Agent Harnesses. Thinking Harder Beat Al... by cyanydeez on Thursday November 05, 2026 @04:44PM (#50384874)
For local model, my goal is keep context around ~128k to optimize capability vs speed without decoherence.

I'm up to ~7m context in a session without spiralling.

I think most of cloud models are like bloated windows.

Re:We Tested Coding Agent Harnesses. Thinking Harder Beat Al... by ffwang2 on Wednesday November 04, 2026 @04:01PM (#50371460)
interesting. there are so many different types of staff engineers. im wondering if the models have optimized for it.

lol maybe more thinking = higher desire to get promoted or an equity refresh.

Re:We Tested Coding Agent Harnesses. Thinking Harder Beat Al... by andrewdong on Wednesday November 04, 2026 @05:23PM (#50372333)
haha /get-promoted
Re:We Tested Coding Agent Harnesses. Thinking Harder Beat Al... by andrewdong on Wednesday November 04, 2026 @05:23PM (#50372336)
actually would lowkey be an awesome skillset
Re:We Tested Coding Agent Harnesses. Thinking Harder Beat Al... by purplemantis on Wednesday November 04, 2026 @04:03PM (#50371491)
I wonder how gstack stacks up (Garry Tan's special coding setup, which he spends $200K/yr on: https://techcrunch.com/2026/11/02/y-combinators-garry-tan-us...)

Maybe all the extra features and scaffolding helped when he first started building it... But I'd bet that raw Claude Code and Codex are smart enough now that they make things worse.

Re:We Tested Coding Agent Harnesses. Thinking Harder Beat Al... by andrewdong on Wednesday November 04, 2026 @05:21PM (#50372317)
TIL about Superpowers!
Re:We Tested Coding Agent Harnesses. Thinking Harder Beat Al... by blake-raymond on Thursday November 05, 2026 @11:15AM (#50380963)
They used their own proprietary benchmark called sudo L7, which purports to evaluate staff-level engineering judgment more than the correctness of the code itself.

Not surprising to me that higher thinking will outperform coding harnesses here.