News for hackers. Stuff that matters.
Re:Smart Programmers Write STUPID Code by MoreQARespect on Sunday October 08, 2023 @02:59PM (#37813377)
>Imagine the following scenario: you have two projects each having the same functionality and the same level of test coverage. Project A is 30% longer than project B but project A's test suite runs in 1 second while project B's runs in 2 minutes. Personally, I am taking project A every time.

Project A's tests will usually be sacrificing realism in favor of speed. The practical upshot of that is entire classes of bug won't get caught.

To take some recent practical examples off the top of my head: I have some tests that do 404 checks on all web pages. I have another that checks if sent emails are outlook compliant. These checks necessitate that the tests be slower but the practical alternative is a human does it.

I know there are plenty of people out there who think like you do. That was kind of my point. Realism in testing is an underappreciated quality.

There are no comments on this comment yet.