Re:Successful machine learning models: lessons learned at Bo...
by huac on Monday October 07, 2019 @06:12PM
(#21186536)
say you want to try adding two features, which don't you think interact with each other, e.g. a change to the "pick this room button" and a change to the checkout flow. then, you can randomly assign users to two experiments, independently. your t-test results should then be valid if the two features are independent.
[ Parent
| on HN ]
Re:Successful machine learning models: lessons learned at Bo...
by anthony_doan on Monday October 07, 2019 @07:36PM
(#21187157)
> which don't you think interact with each other,
> your t-test results should then be valid if the two features are independent.
Assuming that your assumption are correct on interaction effect.
You can do a hypothesis test on that assumption while including both factors (the two features). Which will clear away any doubt with a 95% confidence or hire a statistician =).