Re:27000 errors in the Tizen operating system
by ChrisLomont on Wednesday July 12, 2017 @11:05AM
(#14753140)
Sampling 3.3% of lines in a 72 million line codebase, especially across so many sub projects, is statistically significant enough to make claims like this with decent certainty.
That's a few million sample lines tested.
Re:27000 errors in the Tizen operating system
by ordu on Wednesday July 12, 2017 @11:21AM
(#14753308)
Oh... We can ask about way sub projects were selected, and are they can be called a representative sample.
Nevertheless I agree with you: there are no obvious way to do a better estimation, so words "fair" and "transparent" seem right in place there. Of course only if Karpov does not try to mislead his readers deliberately by choosing sub projects by some criterion that correlates with error rate.
Re:27000 errors in the Tizen operating system
by mnarayan01 on Wednesday July 12, 2017 @11:34AM
(#14753410)
Even if the sampling was rigorously random and no projects were dropped after starting, there would still likely be a bias towards small, "long tail", projects. It seems plausible that these types of projects would have more errors (or vice versa).
...if you can grant them the premise that the 3.3% sampled represents the project as a whole so that the ratio will project out to 27k overall.