News for hackers. Stuff that matters.
Re:Keeping computers from ending science's reproducibility by sparky on Friday January 22, 2010 @12:12PM (#1070045)
Re:Keeping computers from ending science's reproducibility by wmf on Friday January 22, 2010 @06:39PM (#1071000)
PlanetLab and the clouds are great ways to do non-reproducible research, because the other users in the system (where sometimes "the system" is the public Internet) create interference. Reproducible networking research either has to be simulated or has to be run on an isolated testbed such as Emulab.
Re:Keeping computers from ending science's reproducibility by sparky on Friday January 22, 2010 @07:46PM (#1071112)
The results from PlanetLab et al. may not be deterministic, but you should be able to reach the same conclusions based on repeated experiments. Otherwise, your results may be a little too fragile to form the basis of sweeping conclusions.

This may not be ideal, but it is no worse than any branch of science which is not purely digital.

Re:Keeping computers from ending science's reproducibility by jwhite on Friday January 22, 2010 @08:36PM (#1071182)
NICTA and WinLab have developed a management framework called OMF for specifying and running experiments on testbed networks. One of the main goals of the project is to improve reproducibility in networking research.

http://omf.mytestbed.net

(It is mainly written in Ruby)