News for hackers. Stuff that matters.
Re:Beware the Mean by wodenokoto on Tuesday January 28, 2020 @02:03AM (#22167089)
Can you elaborate on the part about sample vs population mean?

The way I see it; in these scenarios you aren’t looking at the sample mean. There is no reason to sample your customer base to get an estimation of your average revenue. You can calculate from the entire population.

Re:Beware the Mean by paulsutter on Tuesday January 28, 2020 @05:55AM (#22168190)
Your current customer base is just a sample of your total market, for example. Next year’s (larger) customer base will be slightly closer to the whole set (so different) but still just a sample.
Re:Beware the Mean by wodenokoto on Tuesday January 28, 2020 @10:58AM (#22170513)
So the point is that the current customer base is a skewed sample of the theoretical customer population.

Therefore we shouldn’t look at the current customer mean profit to predict what would happen to profits if we doubled the customer base.

Re:Beware the Mean by kqr on Tuesday January 28, 2020 @12:48PM (#22171876)
Exactly. These summaries are often used for prediction, which means historic data is used as a sample of the same distribution as future data.

Even when comparing two different historical data sets you have to be careful: if you're doing anything that resembles hypothesis testing (i.e. trying to figure out if something you changed made a difference) you're not really comparing two historical data sets -- you're trying to compare the underlying distributions from which the historical data sets were drawn, but hoping that the historical data are representative samples from those.

Re:Beware the Mean by tomnipotent on Tuesday January 28, 2020 @12:27PM (#22171569)
It's not about the doubling, it's about how the distribution changes as you gather more data and get closer to the actual mean (e.g. if you had EVERY possible customer ever, like cable companies).

Take Tesla, for example. Its first customers were enthusiasts, but the mean of that group is not the mean of all current Tesla customers - they would look very different, and had Tesla optimized for the latter we'd be looking at a very different outcome.