News for hackers. Stuff that matters.

A comment on Automated Unit Test Improvement Using Large Language Models at Meta. Parent comment

Re:Automated Unit Test Improvement Using Large Language Mode... by tvaughan on Saturday February 17, 2024 @05:50AM (#39408317)
Point 3 is the key. Code coverage should only be measured by tests that only use the “external API.”
[ Parent | on HN ]
Re:Automated Unit Test Improvement Using Large Language Mode... by sixstringtheory on Saturday February 17, 2024 @09:07AM (#39409518)
Brilliant distillation of this insight, I've never heard it put in those words before but it's perfect. It cuts both ways too, if you have lots of tests but most of them aren't really exercising the external API, then you're worse off.
[ Parent | on HN ]