Re:How Bad Software Leads to Bad Science
by jacquesm on Friday December 26, 2014 @01:14PM
(#8799550)
That's only one part of the problem. Bad data leads to bad science just as frequently if not more frequently, a limited understanding of the effects of sample sizes on output quality for statistical procedures is another, as well as what the software is actually doing internally.
My main exposure to this has been by observing a biologist draw absolutely unsupportable conclusions from a bunch of very low quality data using some software as if it was a magic incantation. Not that that bothered supervisors or anybody else, as long as the funding kept coming everybody was absolutely happy.
The software wasn't all that bad, even though the user interface was crappy. The whole pipeline did not stand up to scrutiny, and of course my sample rate of this sort of thing is too low to draw conclusions from but I really hope that was an example of how it is normally not done.
Personally I think that if you aren't using software to do something faster that you could do yourself manually then you probably shouldn't be using that software.
My main exposure to this has been by observing a biologist draw absolutely unsupportable conclusions from a bunch of very low quality data using some software as if it was a magic incantation. Not that that bothered supervisors or anybody else, as long as the funding kept coming everybody was absolutely happy.
The software wasn't all that bad, even though the user interface was crappy. The whole pipeline did not stand up to scrutiny, and of course my sample rate of this sort of thing is too low to draw conclusions from but I really hope that was an example of how it is normally not done.
Personally I think that if you aren't using software to do something faster that you could do yourself manually then you probably shouldn't be using that software.