News for hackers. Stuff that matters.
Re:Launch HN: GPT Driver (YC S21) – End-to-end app testing i... by aksophist on Thursday October 24, 2024 @10:25AM (#41935824)
What is a false positive rate? Is it when the agent falsely passes or falsely “finds a bug”? And regardless of which: why don’t you include the other as a key metric?

I’m not aware of any evals or shared metrics. But measuring a testing agents performance seems pretty important.

What is your tool’s FPR on your golden suite?

There are no comments on this comment yet.