News for hackers. Stuff that matters.
Re:Survival of the Wrongest by rm999 on Friday January 18, 2013 @12:40PM (#5079862)
I think this is an important article for the HN crowd. Educated STEM people usually have a strong devotion to science, but science very often fails at revealing the truth (dangerously, in a misleading manner). The article points out the problem isn't malice or incompetence, it's bad expectations.

To me, a critical analysis of research is often more valuable than the research itself.

Re:Survival of the Wrongest by jkubicek on Friday January 18, 2013 @01:04PM (#5080022)
> To me, a critical analysis of research is often more valuable than the research itself.

Critical analysis of research is science. I'm perpetually frustrated with articles like this that seem to portray science as a failure by citing faulty studies, ignoring the fact that everything is working as it should.

Re:Survival of the Wrongest by rm999 on Friday January 18, 2013 @01:33PM (#5080168)
> Critical analysis of research is science

You missed the point in the name of semantics, but I'll bite. Finding flaws in a scientific paper my be taking part in the scientific process, but it is by no means a science in itself - e.g. as a stats person, I can point out when a p value is misapplied, but I would never claim I just 'used science'.

>I'm perpetually frustrated with articles like this that seem to portray science as a failure by citing faulty studies

It's worth separating the philosophy of science from its application. This article is purely about the application and what has gone wrong. This is why I think this article is important for the STEM crowd: we are taught that science is an infallible philosophy (which I agree with), but it's easy to forget the garbage-in garbage-out nature of experimentation.

Re:Survival of the Wrongest by onewland on Friday January 18, 2013 @01:26PM (#5080131)
This is the Columbia Journalism Review. It's not saying science is stupid, it's saying that reporters are too quick to publish study results, when not enough research has been done on the subject topic.
Re:Survival of the Wrongest by jkubicek on Friday January 18, 2013 @01:40PM (#5080205)
JohnsonB's comment[0] draws the same conclusion I did. The article seems to suggest that studies aren't working and we need to start listening to anecdotal evidence. I could have misinterpreted that passage, though.

[0] http://news.ycombinator.com/item?id=5080094

Re:Survival of the Wrongest by rm999 on Friday January 18, 2013 @01:57PM (#5080287)
The idea that scientific research is infallible is exactly what the article is arguing against - in fact, it claims this attitude is a bigger problem than the scientists or the media.

Human-performed studies with limited budgets and unrealistic controls should not supersede expert opinion per se. When there is a disconnect between the two it is irresponsible not to question the scientific studies (in addition to the experts, of course).

Re:Survival of the Wrongest by jkubicek on Friday January 18, 2013 @01:09PM (#5080042)
It bothers me to no end when people discuss "science" as if it were just one of many options available. Science is the pursuit of truth and the pursuit of truth is science. There are no alternatives.
Re:Survival of the Wrongest by tedunangst on Friday January 18, 2013 @04:56PM (#5081293)
Science is a means of pursuing the truth. People who read tea leaves also believe they're pursuing the truth, but nobody would say that's science.
Re:Survival of the Wrongest by pnathan on Friday January 18, 2013 @02:13PM (#5080355)
Is logic science?
Re:Survival of the Wrongest by dkarl on Friday January 18, 2013 @03:52PM (#5080937)
> Educated STEM people usually have a strong devotion to science, but science very often fails at revealing the truth

The article criticizes journalism for not properly reflecting science and scientific opinion, so it implicitly accepts science as the gold standard. I think the lesson is that there's more demand for scientific novelty and certainty than science itself can satisfy, so science journalism focuses on the conjecture, controversy, preliminary results, and premature conclusions that arise in the practice of science instead of focusing on the emergence of consensus among scientists. The job of a science journalist like Tara Parker-Pope or a pop science author/advocate like Gary Taubes is akin to the job of a prosecuting attorney: to tell a single story as compellingly as possible. The article is about cases where journalists succeed in telling a simple, intuitive, compelling story while science itself is telling a collection of messy, incomplete, counter-intuitive, and/or contradictory stories.

I know many "educated STEM people," but I don't know anybody who does any significant reading of scientific literature outside their field. I've read a lot of abstracts (and a few articles, when they're available) while trying to look one layer deeper than the news, but I don't have the background to understand a lot of what I read, and I've never gone to the library and reviewed dozens of related papers to get context for the paper I'm reading, like a real scientist would. Virtually every vote and consumer choice influenced by science is influenced through news media, science journalism, or classroom education, not by direct exposure to the work of practicing scientists.

Re:Survival of the Wrongest by svachalek on Friday January 18, 2013 @05:26PM (#5081436)
I think you missed the second half of the article.
Re:Survival of the Wrongest by dkarl on Friday January 18, 2013 @06:48PM (#5081839)
The article is about "How personal-health journalism ignores the fundamental pitfalls baked into all scientific research." The second half of the article is about biases that influence individual scientists and journals. Scientists acknowledge such factors and do their best, within the limits of their own bias, to take all limiting factors into account when evaluating research. Where the influence of the scientific community coincides, you can expect to see bias shared by all scientists, and where powerful institutions can unduly sway community opinion, bias will bubble up into the community consensus, but scientific consensus is still much more reliable than the results of individual papers or the opinions of individual scientists, because the interests of individual scientists vary and often compete. The article makes the point that journalism should take skepticism within the scientific community about specific claims more seriously and could serve as an outside critical perspective on science, but in fact reads the scientific literature more naively than scientists themselves do.