Re:Show HN: Lost Pixel – open-source visual regression testi...
by testingwaters4 on Tuesday September 20, 2022 @02:47AM
(#32908506)
You could run the suite on the updated browser on the latest passed build, then automatically batch approve since you know it has to be green. Now you can run all the newest test suites in this updated browser against this approved build.
1. Grayscaling browser before screenshot 2. Using custom diffing engines that enable for ignoring regions like odiff 3. Trying to be smart and analyzing images with machine learning to identify how meaningful the difference is (moonshot but worth exploring)
Our approach to this in general is that if false positive like this happens we can just batch approve all the differences and be ok with that as it was a subtle rendering change not dependent on us or our direct third party dependencies.