Backlog.md – CLI that auto-generates task files (took my Claude success to 95 %)

Re:Backlog.md – CLI that auto-generates task files (took my ... by Leave_OAI_Alone on Monday July 07, 2025 @08:37AM (#44489740)

You have compiled an interesting list of benchmarks and adjacent research. The implicit question is whether an established benchmark for building a full product exists.

After reviewing all this, what is your actual conclusion, or are you asking? Is the takeaway that a comprehensive benchmark exists and we should be using it, or is the takeaway that the problem space is too multifaceted for any single benchmark to be meaningful?

[ Parent | on HN ]

Re:Backlog.md – CLI that auto-generates task files (took my ... by westurner on Monday July 07, 2025 @10:11PM (#44496363)

The market - actual customers - is probably the best benchmark for a product.

But then outstanding liabilities due to code quality and technical debt aren't costed in by the market.

There are already code quality metrics.

SAST and DAST tools can score or fix code, as part of a LLM-driven development loop.

Formal verification is maybe the best code quality metric.

Is there more than Product-Market fit and infosec liabilities?

[ Parent | on HN ]