Re:NFL players: height and weight over time
by 3JPLW on Wednesday June 04, 2014 @02:52PM
(#7847392)
Ugh, on [3], watch out for the non-zero axes. NHL and NBA start their axes at 0, while the others do not. Very tricky, and very deceiving. I think NFL would look very similar to NBA if plotted the same way (they're both within ~10-15% of the expected value).
[ Parent
| on HN ]
Re:NFL players: height and weight over time
by ronaldx on Wednesday June 04, 2014 @05:25PM
(#7848437)
The author points out in the text that the NFL result is statistically significant and the NBA result is not.
A larger random sample ought to fall closer to the line than a smaller sample: it would be statistically highly remarkable if the graphs did look similar with zeroed axes - the larger sample should look much flatter.
Starting both graphs from zero is unhelpful if the goal is correct visual interpretation.
Re:NFL players: height and weight over time
by CognitiveLens on Thursday June 05, 2014 @08:08AM
(#7851443)
With broad correlational data like this, it's important to know what significance threshold is being used, and what the significance value actually is. There are many possible analyses that can be run, and there will be some subset of those analyses that produce significant results by chance, which is why you need hypothesis-driven analysis and/or very conservative corrections for post-hoc analysis.
Without the details, we can't evaluate significance claims.
One could argue that the large difference in sample sizes (more than fivefold) justifies scale manipulation to bring the variances into line, but it doesn't appear to me that the author normalized on variance at all (the axis should be something like 800-2000).
Re:NFL players: height and weight over time
by ronaldx on Wednesday June 04, 2014 @08:50PM
(#7849486)
I agree with what you say.
To correctly compare the variances, the scale should be adjusted according to the square root of the ratio of sample sizes.
The author has not done this correctly, but I claim that zeroing the axis would be further from the correct graph.
Re:NFL players: height and weight over time
by craigmbooth on Thursday June 05, 2014 @09:13AM
(#7851740)
Ah, you are correct, thank you. Apparently I wasn't thinking clearly when I normalized the axes to have the same absolute ranges.
I generally feel that zeroing the axis is never wrong, but yes, in this instance a (properly) cut axis would be better than correct. However, it should be apparent at a glance, and the presence of the other two graphs complicates things as well, so I have some reservations.