I feel like Apple’s method is much better than blindly trying to interpret data and let that drive you over the cliff. Data isn’t a replacement for understanding of your product and users.
The more surprising conclusion is that the dumb, data-driven rules outperform experts even when the experts get access to the same data and the decision made by the data-driven rule. Why? Humans have a tendency to think they're better than dumb rules and override these dumb rules in ways that make their decision ultimately worse.
The result has remained remarkably consistent across many fields where people were sure it wouldn't apply. At this point it's stable enough that I think the conclusion is a good base assumption, and it would take serious evidence to show that it does not apply in any given field.
I would be grateful if you can share Apples general approach to product development.
https://hbr.org/2020/11/how-apple-is-organized-for-innovatio...
A company that is famous for being metrics driven and having teams that optimise for their own metrics is Facebook. You can tell that the product has "seams". Each page and widget feels like it was individually optimized and then stitched together. Overall it somehow feels off.
Apple puts design on top and has a kind of dictatorial veto over all aspects of the product. Hence products made by Apple feel seamless and cohesive. They are also more polished because when you solely rely on metrics you make it as good as it needs to be and then stop.