News for hackers. Stuff that matters.
Re:TTNT: Test This, Not That by hinkley on Friday October 02, 2015 @02:43PM (#10320432)
Flakey always seems tolerable when you have 400 tests and you get one or two false reports a week. What people don't get is the the chance of failure is multiplicative, not additive, not fixed. So when you use that function 10 times as often it fails 12 or more times as often.

Tests are there to fight our natural tendency toward wishful thinking. Tests that fail for no reason enable people to keep thinking there was nothing wrong with their code. Meanwhile other people are twiddling waiting for them to fix something they don't think they broke.

Re:TTNT: Test This, Not That by wdewind on Friday October 02, 2015 @03:30PM (#10320706)
Sorry I didn't mean flakey in the sense of the tests themselves, but the algorithm that selects which tests need to be run.