Re:How to invite users to your app
by gfodor on Friday May 03, 2013 @02:27PM
(#5651716)
Depending on how many users this app has, A/B testing may not be possible. After working for a larger company that had lots of traffic, I started to take it for granted that I could run an experiment for a day and get an answer. When bootstrapping a new product, you just have to throw stuff at the wall based on intuition (and customer development) and hope something clicks so you can get that stream of traffic to A/B test with.
[ Parent
| on HN ]
Re:How to invite users to your app
by orangethirty on Friday May 03, 2013 @04:50PM
(#5652575)
You can run very small tests, though. They will not scale, but will give some insight into what the current user base prefers.
That all depends if you can get statistical significance. The catch-22 here is that the only way to really get statistical significance without a lot of data is to have a clear winner, which would have probably jumped out as a better solution regardless of how rigorous your testing methodology is.
The worst thing you can do is run a test and jump to conclusions based upon limited data.