News for hackers. Stuff that matters.
Re:How we reduced our cancellation rate by 87.5% by jmilloy on Sunday June 17, 2012 @08:48AM (#4122838)
I don't really understand. Isn't the "cohort analysis" part of it how the data about the gyms that cancelled was extracted? That shouldn't affect how you compare the results once you've made changes. I'm also not sure I understand what you mean by "comparing a pre-change cohort to a post-change cohort" because we're not comparing the cohorts, we're comparing the cancellation rate among the whole list of customers.
Re:How we reduced our cancellation rate by 87.5% by jamiequint on Sunday June 17, 2012 @10:46AM (#4123041)
Ah, the article is actually extremely unclear. What I took his conclusion to mean was that some cohort of gyms that had signed up post-change had lower cancellation rates than pre-change customers. If the analysis just took into account the overall rate across all customers is prone to all sorts of errors (including the one you mention).
Re:How we reduced our cancellation rate by 87.5% by ehsanu1 on Sunday June 17, 2012 @02:49PM (#4123531)
My impression was that the pre-change cancellation rate was based on all customers over the lifetime of the product (they did calculate the 61 day average from this), whereas the post-change was only for the new customers in the last two months (the max it could be, and the only thing it makes sense to measure).