News for hackers. Stuff that matters.
Re:Hyperbaric oxygen therapy reverses hallmarks of Alzheimer... by tgv on Monday September 13, 2021 @10:00AM (#28511589)
I also find it a bit hard to believe that going from 102±7 to 109±5 has a p<0.005. If I run a simple t-test, it says p-value (two-tailed) = 0.07.
Re:Hyperbaric oxygen therapy reverses hallmarks of Alzheimer... by hervature on Monday September 13, 2021 @11:48AM (#28512987)
It is a paired t-test as the test takers are the same individuals. This is confirmed in the statistical analysis section of the actual paper. Paired t-test have more statistical power because we don't correct for group variation (as they are the same group measured twice).

Edit: One way to think about this is assuming the effects are random and symmetric then the probability of going up is 1/2. If all 6 participants had increased scores, then the p-value is at least 1/2^6 and this is not taking into account the magnitude of the shift.

Re:Hyperbaric oxygen therapy reverses hallmarks of Alzheimer... by tgv on Monday September 13, 2021 @12:56PM (#28513777)
You're right about the paired test (although I think there's an issue with the group variance). But your final calculation is for a sign test. For a t-test where every point shifts a very little bit (e.g. 0.01 stddev), p is larger, I think.
Re:Hyperbaric oxygen therapy reverses hallmarks of Alzheimer... by hervature on Monday September 13, 2021 @02:22PM (#28514868)
Yes, my edit was more meant to illustrate how 6 data points can yield a significant result. Paired t-test is all about the differences. So if all test subjects shift up by 0.01 (no variance in the differences) then the statistic will actually be infinite (i.e. very large) and so p is theoretically 0 (very small). I also agree that the paired testing needs more convincing from the researchers.
Re:Hyperbaric oxygen therapy reverses hallmarks of Alzheimer... by neffy on Monday September 13, 2021 @11:30AM (#28512748)
Unfortunately a lot of medical science involving expensive laboratory resources and trials currently rests on sample sizes around this range (~5-20). Then whenever there's any kind of technical innovations that makes it cheaper to collect the biosignals there is a sudden series of breakthroughs in what is really happening. All science is a work in progress.