News for hackers. Stuff that matters.
Re:Probabilistic Flakiness: How do you test your tests? by pfdietz on Monday December 21, 2020 @09:41PM (#25502282)
Mutation testing is a way to test your tests.
Re:Probabilistic Flakiness: How do you test your tests? by jaggederest on Monday December 21, 2020 @10:06PM (#25502410)
And will very quickly humble even the most diligent of testers :) For example, you're testing that this value is in a range - but are you testing both endpoints and whether they're inclusive or exclusive? In faster languages I enjoy quickcheck style testing which also reveals these things pretty quickly.
Re:Probabilistic Flakiness: How do you test your tests? by vlovich123 on Tuesday December 22, 2020 @12:18AM (#25503145)
Do not confuse end-to-end functional tests that this article is describing for smaller “unit” tests that you typically might express in quick check/mutation testing (at least as I understand the space).