News for hackers. Stuff that matters.
Re:Show HN: OSS Agent I built topped the TerminalBench on Ge... by blurbleblurble on Monday April 27, 2026 @10:59AM (#47922529)
Did you consider incorporating ast-grep or gritql?

Congratulations, great work.

Re:Show HN: OSS Agent I built topped the TerminalBench on Ge... by sally_glance on Monday April 27, 2026 @11:26AM (#47922896)
Can't speak for OP but I tried providing ast-grep in the execution context of an execute_bash tool, but even with pretty aggressive steering most models just don't seem to use it a lot. More expensive/SOTA models or higher reasoning increases the chances but lowers speed and raises cost. Maybe due to training bias for exploration tasks?
Re:Show HN: OSS Agent I built topped the TerminalBench on Ge... by blurbleblurble on Monday April 27, 2026 @11:30AM (#47922944)
Yes, I've tried this passive approach too and didn't dig much further after that. I thought maybe they'd figured out something more intentional in the prompting to enable these kinds of approaches.
Re:Show HN: OSS Agent I built topped the TerminalBench on Ge... by sally_glance on Monday April 27, 2026 @11:46AM (#47923131)
I have a hunch model proficiency for a given CLI tool very much correlates with how many StackOverflow answers and blog entries providing examples for it there are...
Re:Show HN: OSS Agent I built topped the TerminalBench on Ge... by blurbleblurble on Monday April 27, 2026 @11:57AM (#47923283)
My sense is that we're at a tipping point where instruction following is getting good enough to disrupt these old habits
Re:Show HN: OSS Agent I built topped the TerminalBench on Ge... by GodelNumbering on Monday April 27, 2026 @12:40PM (#47923896)
Not really, but interested in trying them out for a future version, especially gritql.