News for hackers. Stuff that matters.
Re:We Should Not Accept Scientific Results That Have Not Bee... by batbomb on Friday July 29, 2016 @01:31PM (#12188385)
In fact, CMS and ATLAS are sort of same experiment repeated twice, just in parallel rather than serially. Repeatable doesn't imply identical experimental design.
Re:We Should Not Accept Scientific Results That Have Not Bee... by bordercases on Friday July 29, 2016 @03:39PM (#12189394)
Does it not? If the experimental design is not preserved, don't you open yourself to inconsistent controls between the experiments? Where do you draw the line?
Re:We Should Not Accept Scientific Results That Have Not Bee... by shkkmo on Friday July 29, 2016 @05:07PM (#12189992)
If you think about it, complete replication of any experiment is useless, and impossible.

But that doesn't matter, because it is not the experiment you are trying to replicate, is the effect or the observation.

Carefully changing the design of the experiment can allow to verify that your explanation of the effect or observation is accurate.

Of course, if the change the experiment too much, a failure to replicated will have less useful information.

Re:We Should Not Accept Scientific Results That Have Not Bee... by bordercases on Monday August 08, 2016 @02:06PM (#12249691)
In hindsight I do think it's true that you want numerous experiments with possibly different controls with the exception of whatever is important for the effect. In that sense you want your experiment to "discover the right abstraction" of details that your principle works over.

So I think what has to occur is a gradual "loosening up" of the controls from strict replication to weak replication, with both types of replication giving information about the effect you are testing: its validity and its generality, respectively.