News for hackers. Stuff that matters.

A comment on Ask HN: Has anyone read the “Focusing on the Long-term” paper from Google? [pdf].

Re:Ask HN: Has anyone read the “Focusing on the Long-term” p... by root_node on Monday August 10, 2020 @03:27PM (#24113064)
Almost every company that's out there runs some form of A/B tests to measure the success/failure of their features. Typically, A/B tests span a few weeks (2-3). Is that timeframe enough to make critical decisions? What's your take on short lived A/B tests? I found the paper interesting. Has anyone tried this/something similar outside of Google?
[ Parent | on HN ]
Re:Ask HN: Has anyone read the “Focusing on the Long-term” p... by cloudking on Monday August 10, 2020 @05:13PM (#24114057)
I think A/B testing largely depends on your sample sizes. If you have a very high traffic product, it's easier to get statistical significance in a shorter time frame.
[ Parent | on HN ]