News for hackers. Stuff that matters.
Re:Show HN: Hercules – Open-Source software testing agent by Smilinrobin on Wednesday November 20, 2024 @03:25PM (#42197764)
In theory , yes we could, but would it yield "good enough" results for a "testing" agent- Probably not. The LLM here is actually not just responsible for tool calling, its also doing other intricate things such as planning the next steps based on the input feature file, and generating the browser/API automation code. In our experiments we found that OpenAI 4o performs best, followed by Haiku or Grok.

There are no comments on this comment yet.