News for hackers. Stuff that matters.
Re:We reduced our iOS app launch time by 60% by AnIdiotOnTheNet on Tuesday February 07, 2023 @11:22AM (#34694753)
Are such metrics even meaningful? It sounds like metrics-for-the-metrics-god, useless unactionable information.
Re:We reduced our iOS app launch time by 60% by brookst on Tuesday February 07, 2023 @11:35AM (#34694944)
The problem is you often don’t know what metrics are meaningful until after the fact.

Like, if new order starts drop by 4% while traffic remains constant, what happened? If that happens, you might want to see if people are using the menu more because something got harder to find on the page.

I doubt anyone is looking purely at menu opens as a metric, unless maybe trying to reduce it. But for ongoing funnel and ad hoc investigations it could be useful. So you collect it.

The obvious answer is sampling rather than collecting for every user, but then you get into complicated statistics about required sample sizes if you want to correlate multiple actions across tech and demographics. Again, easier to just collect it all.

Re:We reduced our iOS app launch time by 60% by 6510 on Tuesday February 07, 2023 @12:12PM (#34695523)
Do many oversized tests but carefully avoid testing the test themselves because why would you? Would you test the test of the test too? etc? Someone might one day conclude the tests cost more than they are worth but it wouldn't be the ones hired to inflict them.
Re:We reduced our iOS app launch time by 60% by crazygringo on Tuesday February 07, 2023 @11:35AM (#34694939)
Metrics are frequently used for debugging, not just for information that is planned to be "actionable".

E.g. somebody is complaining that the hamburger menu doesn't work, and then you can go deep into the analytics and discover that no hamburger-menu-open events get fired on a certain version of a certain browser. Now you know what to test and fix. Without analytics for everything, that would have taken a lot longer to track down and might not have gotten fixed at all, because it would just be something intermittent you don't know how to reproduce.