The LLM Critics Are Right. I Use LLMs Anyway

Re:The LLM Critics Are Right. I Use LLMs Anyway by what on Thursday July 16, 2026 @09:20PM (#48942358)

You can write tests that cover every line/branch without actually verifying the code does what it’s supposed to. Relying on (unreviewed?) LLM written tests that provide coverage may not be a great idea.

[ Parent | on HN ]

Re:The LLM Critics Are Right. I Use LLMs Anyway by westurner on Friday July 17, 2026 @08:05AM (#48946338)

So, a project can have 100% test coverage (the tests run each line or branch at least once without any errors or failures) but fail acceptance tests.

If there is prompt insufficiency, there is probably acceptance test insufficiency.

A more assuming agent could automatically develop a plan that includes presumptive acceptance tests and request feedback before spending tokens

[ Parent | on HN ]