News for hackers. Stuff that matters.

A comment on What We Learned from Analyzing 100M Bugs. Parent comment

Re:What We Learned from Analyzing 100M Bugs by aprilledaughn on Thursday July 19, 2018 @03:05PM (#17569357)
Yes, you’re right! The report covers data from Instabug users only. We extracted data from 30K apps with a range of user base sizes, locales, devices, etc. I definitely agree with you, it’s not a definitive representation of the market, but we believe we have a good enough sample and that the findings are valuable for app developers.

We couldn’t find any other data on mobile bugs like this, so we decided to share what we have for the app dev community to have some benchmarks and insights.

[ Parent | on HN ]
Re:What We Learned from Analyzing 100M Bugs by minimaxir on Thursday July 19, 2018 @03:24PM (#17569484)
Sample size isn't the issue here, although a large heterogenous sample is good.

The complaints are e.g. "Most bugs are reported from iPhones" because they are a very popular type of phone with the customers more likely to report bugs. It doesn't necessarily mean the iPhone is buggier than others.

[ Parent | on HN ]
Re:What We Learned from Analyzing 100M Bugs by aprilledaughn on Thursday July 19, 2018 @03:36PM (#17569573)
Right, we're definitely not saying the iPhone is buggier than others. I guess the issue is with the wording of the claim. It would be more accurate to say "Most bugs reported through Instabug are from iPhones"

That's also why we included the bugs/user data since it shows a completely different distribution across devices.

[ Parent | on HN ]