News for hackers. Stuff that matters.

A comment on Automated Unit Test Improvement Using Large Language Models at Meta. Parent comment

Re:Automated Unit Test Improvement Using Large Language Mode... by adrianN on Saturday February 17, 2024 @02:58AM (#39407409)
In sufficiently large systems there is some value in test that just detect changed behavior, even if the behavior is buggy. Parts of the code probably rely on the bugs and accidentally (or intentionally) fixing them can lead to more severe problems.

Of course these kinds of tests are no replacement for tests that check actual requirements.

[ Parent | on HN ]
Re:Automated Unit Test Improvement Using Large Language Mode... by sixstringtheory on Saturday February 17, 2024 @08:59PM (#39415400)
> Parts of the code probably rely on the bugs

The combination of pieces is what should be tested then, not the behavior of each individual piece “just in case something needs it that way”. You’ll never be able to change anything with that approach. And why shouldn’t bugs be fixed anyways?

[ Parent | on HN ]
Re:Automated Unit Test Improvement Using Large Language Mode... by therealdrag0 on Sunday February 18, 2024 @04:55PM (#39423837)
It’s not that bugs shouldn’t be fixed it’s that they should be fixed intentionally, and with awareness of what the fix might break so you can make it backwards compatible if necessary.
[ Parent | on HN ]