Re:Could It Be? Spooky Experiments That 'See' The Future
by hammock on Tuesday January 04, 2011 @08:49PM
(#2069453)
actually you ought to have selected n number of tests beforehand, rather than see the fluke and, after the fact, "continue testing" until it goes away.
the very moment you peek, your data is tainted from future testing.
The only way to find out is to do enough flips to eliminate the chances of your final result being influenced by statistical flukes. Measuring small differences, like trying to answer "does a coin preferentially land on one side vs the other?" usually takes hundreds of thousands of tests to guarantee you're seeing objective data, rather than seeing patterns in noise.