Re:Tyranny of the Marginal User: why software gets worse, no...
by mlyle on Tuesday September 19, 2023 @02:11PM
(#37573871)
I appreciate your comment. I guess what I'm saying is:
I love statistics and econometrics and testing beliefs with data.
But at some point, you do need to think about how to relate to human beings and what is, overall, "good business." That is, data are not replacements for clinical judgment about what is reasonable.
Coming up with ever-more-sophisticated ways to measure what is revenue maximizing but "not quite too abusive" isn't how we keep a good reputation or create a good world to live in.
Of course, completely ignoring indicators and making choices purely based on intuition and values isn't great, either.
And yes, 12 months is arbitrary and doesn't capture everything, and longer windows of analysis are possible, but waiting even longer just throws the signal-to-noise ratio too far in the direction of noise.
FWIW, I no longer at Amazon, but I've yet to see a company of significant scale apply this level of econometrics so rigorously in day to day business decisions, not that they would evaluate 12 months as a baseline (most companies and most A/B tests are much shorter, obviously). I'm sorry you've had bad experiences, and anyways I think it's overall good for society to cultivate strong alternatives to Amazon, but as invisible as it may be to you as a consumer, your data and your lost value as a customer are definitely accounted for within these methodologies, even if no visible changes are happening or they're not winning you back.