Re:I found a bug in SQLite
by deepsun on Monday December 12, 2022 @02:31AM
(#33951945)
Not if a simple test requires rewriting hundreds of tests (aka "fragile tests").
Yes, one shouldn't be writing fragile tests, but usually from what I seen at projects with great test coverage, is that it often slows bugfix releases, and especially any bigger changes, as it's very wearisome to also change hundreds of tests.
So I believe there should be some balance between tests/code ratio, as well as attention paid to tests brittleness.
Re:I found a bug in SQLite
by 2rsf on Monday December 12, 2022 @06:08AM
(#33953390)
Definitely, some real world cases research show that this balance stands around 80% for unit tests- you don't earn more quality as you add more test above that.
Yes, one shouldn't be writing fragile tests, but usually from what I seen at projects with great test coverage, is that it often slows bugfix releases, and especially any bigger changes, as it's very wearisome to also change hundreds of tests.
So I believe there should be some balance between tests/code ratio, as well as attention paid to tests brittleness.