Re:Conservation of Intent: why A/B tests aren’t as effective...
by kolpa on Tuesday July 03, 2018 @06:12PM
(#17453984)
Long-term A/B testing has major problems in the modern world where users can communicate with each other (both onsite and out of band) and can use multiple accounts / devices / browsers
Something as basic as mod(hash(experiment_group_id or layer id, userid), 1000) would give you a user stable experiment distribution that you can analzy long term impact on.