wcypig
Re:Scalable A/B Experiments at Pinterest
on Thursday August 21, 2014 @06:41PM (#8210037)
1) it is true that the more tests you run the higher chance you see one FP, however the tests are not rejected/accepted as a whole. each test will show it's own results.
2) the size effect did take into considerations, there's also r scripts to analyze the results. the impact is trivial