News for hackers. Stuff that matters.
Re:Launch HN: Momentic (YC W24) – Agents that catch bugs by ... by jeffan on Monday November 02, 2026 @01:02PM (#50340863)
Yes we are (it's MIT licensed)! Feel free to email me at [email protected] or file a pull request directly on https://github.com/momentic-ai/qa-bench

Everything has to be reproducible and runnable by the general public

Re:Launch HN: Momentic (YC W24) – Agents that catch bugs by ... by adwad on Monday November 02, 2026 @01:52PM (#50341684)
Thanks, that makes sense!

One suggestion for the future: QA Bench would be even more valuable with a human benchmark, so you can clearly see how the agents perform compared to human QA testers. That would settle that discussion also :)

Re:Launch HN: Momentic (YC W24) – Agents that catch bugs by ... by jeffan on Monday November 02, 2026 @02:20PM (#50342151)
Haha amazing idea! FWIW in the past we have worked with external QA to label ground truth but it was so riddled with errors we decided to put 3 full-time SWEs on it instead.
Re:Launch HN: Momentic (YC W24) – Agents that catch bugs by ... by MGabrielDenton on Monday November 02, 2026 @09:05PM (#50347076)
Can confirm... not fun