News for hackers. Stuff that matters.
Re:Show HN: OSS Agent I built topped the TerminalBench on Ge... by Clueed on Tuesday April 28, 2026 @02:32AM (#47931066)
I tried it with minimax 2.7 and it really didn’t like the editing tool; collapsing rather quickly to using sed to edit files.

I guess it makes sense that models don’t generalize perfectly to arbitrary tools but are biased to those in its training data, especially for a common operation like editing files.

The Gemini family might be a good pick here since it generally underperforms in agentic tasks (due to lack of training data or other reasons) and thus might not have this inherent bias towards specific tools.

There are no comments on this comment yet.