News for hackers. Stuff that matters.
Re:Plan to replicate 50 high-impact cancer papers shrinks to... by buchanae on Monday August 06, 2018 @10:03PM (#17703381)
And another thing! Why should a project be done when it gets published?! What kind of software project would make one release and call it good forever? Nonsense.
Re:Plan to replicate 50 high-impact cancer papers shrinks to... by fmap on Tuesday August 07, 2018 @01:33AM (#17704100)
In an ideal world you would be right, but that's not how the funding structures for academic research are set up.

Think of a research lab as a company that gets paid per prototype and then has to market the concept for the next prototype in an infinite loop. If you can't package up what you're doing into a sequence of small prototypes then you're not getting paid.

Re:Plan to replicate 50 high-impact cancer papers shrinks to... by ajuc on Tuesday August 07, 2018 @02:26AM (#17704245)
The requirement for publishing in a scientific journalshould be opensourcing all the code used.

You can't expect the results to be reproductible 20 years later otherways.

Re:Plan to replicate 50 high-impact cancer papers shrinks to... by skummetmaelk on Tuesday August 07, 2018 @04:27AM (#17704723)
20 year old code that has not been maintained most likely would not run on a modern system anyway, unless it is extremely simple.
Re:Plan to replicate 50 high-impact cancer papers shrinks to... by azernik on Tuesday August 07, 2018 @04:39AM (#17704771)
Research labs operate on a very slow tech upgrade cycle anyway; since code is handed down from assistant to post-doc to grad student, complete rewrites would take up a significant fraction of a person's time at any given lab, and so codebases are often as long-lived as the labs in which they live. We're talking decades-old FORTRAN here. Running twenty-year-old software is a barrier for some labs, but not all.
Re:Plan to replicate 50 high-impact cancer papers shrinks to... by _Wintermute on Tuesday August 07, 2018 @01:05PM (#17708407)
My experience is the opposite, that a lot of labs are running R code that won't work 6 months later, and no one actually recorded the package version numbers that were used.
Re:Plan to replicate 50 high-impact cancer papers shrinks to... by azernik on Tuesday August 07, 2018 @05:58PM (#17711241)
TBF, the experience I have is with physics and mechanical/civil engineering labs, where there historically hasn't been much of a reliance on R. And in any case said experience is several years out of date.

Speaking of, I haven't played with R - what are its standard methods for handling dependencies? I'm particularly enamored of the pip and npm way of doing it, where you create a version-controlled artifact (requirements.txt and packages.json, respectively) that defines your dependencies. Does R not have a similar system, or do people just not use it?

Re:Plan to replicate 50 high-impact cancer papers shrinks to... by _Wintermute on Wednesday August 08, 2018 @03:23AM (#17713827)
R isn't fantastic for handling dependencies. If your code is bundled up as a package then you can specify version numbers for your dependencies, but I don't know of any equivalent to `pip freeze` to actually list these. Installing anything other than the latest version of a package is a bit of a pain, and setting up environments for separate projects is pretty much unheard of.

I'm a bit bitter about the whole "writing reproducible code in R", as I'm currently wasting a lot of time trying to get R code I wrote at the start of my PhD to run again now I'm writing up.

Re:Plan to replicate 50 high-impact cancer papers shrinks to... by nonbel on Wednesday August 08, 2018 @07:33AM (#17714965)
Re:Plan to replicate 50 high-impact cancer papers shrinks to... by ajuc on Tuesday August 07, 2018 @04:40AM (#17704773)
It can always be ported. Without the code you're stuck.
Re:Plan to replicate 50 high-impact cancer papers shrinks to... by a_136_chiffa on Friday August 10, 2018 @12:45PM (#17734876)
One where you don't get sustained funding to maintain it. In compbio even major resources, known to everyone in the domain only have funding from one two-year grant to another.
Re:Plan to replicate 50 high-impact cancer papers shrinks to... by your-nanny on Tuesday August 07, 2018 @09:05AM (#17706152)
I don't really understand what you are suggesting should be done? data-mining?

also, labs keep the data around, and sometimes use it again for novel posthoc analyses, even years later. in fact that's what I'm doing now!

Re:Plan to replicate 50 high-impact cancer papers shrinks to... by roel_v on Tuesday August 07, 2018 @01:58AM (#17704163)
Who pays for that?