News for hackers. Stuff that matters.
Re:Reducing churn with Econometrics by paulgb on Monday May 28, 2012 @03:13PM (#4034579)
From the title I was hoping this would talk a little more about the model used. At 45 minutes runtime, I'm guessing it's something more interesting than a basic linear model.
Re:Reducing churn with Econometrics by hermannj314 on Monday May 28, 2012 @04:24PM (#4034808)
After taking the Stanford online machine learning course last Fall, I was very interested to hear the details about the model they used. Magic statistics apparently.

While it is good to identify users that might be leaving, it does not do any good if the intervention strategy doesn't impact overall churn.

There is also the other side of the coin. Let's say your model predicts a user as "extremely unlikely" to quit the site. If that user attempts to leave the site you may be more inclined to offer them incentives to stay, knowing they will accept a one-month 50% discount or something like that. Or perhaps their usage indicates the level of value they derive from the site, and so you can offer targeted pricing based on what you believe that class of user is willing to accept. If they user doesn't use the site as much, then maybe you could offer them an unlisted pricing tier that fits their usage profile.

And this is why I am not a business executive, it just feels like throwing spaghetti at a wall.

Re:Reducing churn with Econometrics by zzleeper on Monday May 28, 2012 @11:55PM (#4035890)
They probably just used a logit model, as Stata doesn't support fancy ML algorithms.

What puzzles me though, is that I don't see ANY reason for using alal of these tools together (Stata, R, SAS, etc.) and the code taking one hour to run in a big computer.

Re:Reducing churn with Econometrics by zissou on Tuesday May 29, 2012 @06:28AM (#4036798)
The model described in the post isn't really an econometric model, for a couple of reasons. First, the underlying theoretical model simply throws the kitchen sink on the RHS of the equation, with little to no economic motivation given for why the chosen independent variables were hypothesized to explain the variation in the dependent variable.

Secondly, only a tiny fraction of economists today actually use any statistical learning methods. Economists still don't do much prediction -- as in "predicting tomorrow, today", or even "predicting today, today" -- both of which differ from forecasting. On the other hand, microeconomic fields like game theory, labor and industrial organization often use models that are extremely rigorous in terms of the underlying economic theory, as well as with the econometric analysis, and interpretation of the results. (see: Microeconometrics)

So to the blog poster that just hired an econometrician: you didn't, you hired a statistician or computational learning fella, which from the sounds of it is working out great. So my apologies for being a stickler here, but the post didn't have any real economic theory behind it. Just some data and the results of computations on that data.

Re:Reducing churn with Econometrics by thauck on Monday May 28, 2012 @05:02PM (#4034913)
This is similar to the Adobe article on HN yesterday. Link bait for real improvement through statistical analysis, then the article undelivers.
Re:Reducing churn with Econometrics by ryancarson on Monday May 28, 2012 @05:17PM (#4034962)
Once we figure out if this model actually reduces churn, then we'll be happy to share.

However, you should be aware that there's no silver bullet here. The algorithm we choose might work brilliantly for us and terribly for you.

I wrote the post to get people thinking about how to use data and behavior to drive down churn.

Re:Reducing churn with Econometrics by tshauck on Monday May 28, 2012 @08:14PM (#4035454)
I'm well aware. It comes down to the right combination of an algorithm and heuristics. And it's the heuristics part that is rarely transferable from problem to problem, the part you laid out in bullet points for your hired gun.

I'm just interested in understanding the methodologies, and "cherry-picking" what's applicable to my problems.

Re:Reducing churn with Econometrics by rhizome on Monday May 28, 2012 @06:18PM (#4035163)
What people seem to be commenting on is that there's a difference between reducing churn through econometrics, and an attempt to do so. The title asserts the former, that the post contains an answer.