Re:Scientist: Measure Twice, Cut Over Once
by vdm on Thursday February 04, 2016 @04:47AM
(#11032916)
Twitter's Diffy goes further: it first computes a diff between two controls, to detect non deterministic output (e.g. transaction IDs) as false positives, which can then be omitted from the metrics, and then diffs this first diff against the output of the candidate.
https://blog.twitter.com/2015/diffy-testing-services-without...