Show HN: CVE-Bench, the first LLM benchmark using real-world web vulnerabilities
https://github.com/uiuc-kang-lab/cve-benchmark
AI agents now have impressive reasoning capabilities. This raises an important question: how dangerous are these AI agents at identifying & exploiting web vulnerabilities?We created CVE-bench to find out (I'm one contributor of 16). To our knowledge CVE-bench is the first benchmark using real-world web vulnerabilities to evaluate AI agents' cyberattack capabilities. We included 40 CVEs from...