News for hackers. Stuff that matters.
Re:Successful machine learning models: lessons learned at Bo... by huac on Monday October 07, 2019 @06:12PM (#21186536)
say you want to try adding two features, which don't you think interact with each other, e.g. a change to the "pick this room button" and a change to the checkout flow. then, you can randomly assign users to two experiments, independently. your t-test results should then be valid if the two features are independent.
Re:Successful machine learning models: lessons learned at Bo... by anthony_doan on Monday October 07, 2019 @07:36PM (#21187157)
> which don't you think interact with each other,

> your t-test results should then be valid if the two features are independent.

Assuming that your assumption are correct on interaction effect.

You can do a hypothesis test on that assumption while including both factors (the two features). Which will clear away any doubt with a 95% confidence or hire a statistician =).