I'm curious to see benchmarks when you have access to source code. While traditional QA does not get access to the codebase, with LLMs being primary authors of the code, there are no real practical barriers to giving code access to the testing agents.

At my last job, we did this - gave access to codebase to codex/CC, allowed it to drive the app via browser (+ playwright). It not only found bugs but also correlated them to relevant UI and backend code. We didn't benchmark against anything else, but it was amazing to see it in action.