News for hackers. Stuff that matters.
Re:Trust Me, I'm a Scientist by Alex3917 on Thursday May 05, 2011 @10:15AM (#2517417)
"Likewise, if you can't know _when_ the scientists are wrong with >90% accuracy, you should just shut up and trust the scientists _always_. But, of course, this is not what people do."

The problem is that it's trivially easy to find MAJOR errors in the methodology or interpretation of many or even most journal articles, and whatever passes for the scientific consensus is usually based directly off a very shallow reading of the abstracts and conclusions of these articles without taking any of their flaws into account, let alone questioning the epistemology behind them. There are probably fields where this isn't true, but they're definitely the minority. When the scientific consensus changes it's rarely because of brilliant new research, but rather because the flaws in old research gradually get publicized and so the old conclusions get replaced by the conclusions of new research that's also flawed, but where the flaws aren't yet widely known. But there's no reason why you can't actually figure out what these flaws are, it's not difficult at all, it's just that most people (including scientists) are too lazy to read the actual papers and think critically about them.

The point is that people who buy into scientific consensus wholesale aren't actually the rational skeptics they market themselves as being, but rather are just as dumb and ignorant as the worst of the religious fundamentalists.

Re:Trust Me, I'm a Scientist by syllogism on Thursday May 05, 2011 @10:26AM (#2517451)
That's true of a lot of the "science" that makes its way into the media spotlight. Much of that is actually just PR: "Hershey's scientists find chocolate is better than sex!", etc. I don't think you'll find that true at all of serious, impactful papers that actually have an influence on consensus in a field.

If that were true, then the figure for scientific consensus being true would be much lower than 90%. But I don't believe that. I'd have to wonder what these scientists were doing, that I could just waltz in and blow them away with my wits and reason. I mean, what are the other scientists in this hypothetical field _doing_? Are they that incompetent or corrupt, that I can just blow a hole in their field based on casual observation? Why can't they see the same things I can?

This brings me back to that journal benchmark. Do you think you could write a summary paper discounting a substantial body of research for exhibiting various flaws? If so, do you think it would be accepted? I suggest there are few fields where it's really that easy.

Re:Trust Me, I'm a Scientist by Alex3917 on Thursday May 05, 2011 @10:35AM (#2517492)
"If that were true, then the figure for scientific consensus being true would be much lower than 90%."

I think if you actually look at research about the historical validity of science, you'll in fact find that the 90% figure is a wild overestimate. There are dozens of disciplines where virtually every single scientific consensus in the entire field has been overturned.

http://www.newyorker.com/reporting/2010/12/13/101213fa_fact_...

http://www.theatlantic.com/magazine/print/2010/11/lies-damne...

Re:Trust Me, I'm a Scientist by aterimperator on Friday May 06, 2011 @10:58AM (#2521102)
"There are dozens of disciplines where virtually every single scientific consensus in the entire field has been overturned."

You seem to be arguing that since mankind once thought the world was flat and was wrong, and then mankind thought the world was round and was wrong (more oblate spheroidal), and then mankind thought the world was oblate spheroidal and was wrong, we definitely can't trust the scientific consensus that the world is approximately oblate spheroidal with a very slight bulge south of the equator. Indeed, maybe the earth will turn out to be cubical tomorrow, and a taurus the day after that.

"Wrong" is a relative statement. Saying the earth is flat is more wrong than saying the earth is a sphere, and saying the earth is a sphere is more wrong than saying the earth is oblate spheroidal. Yes they're all wrong, just as newtonian mechanics was, strictly speaking, "wrong", yet no one looks at a car and says "that was built using newtonian mechanics, and therefore can't possibly work".

http://www.youtube.com/watch?v=2tcOi9a3-B0

Re:Trust Me, I'm a Scientist by realitygrill on Thursday May 05, 2011 @10:35AM (#2517493)
Re:Trust Me, I'm a Scientist by rauljara on Thursday May 05, 2011 @10:29AM (#2517468)
You accuse people of being too lazy, but as you pointed out, science does change because flaws in research do eventually get pointed out. In fact, there is an entire profession devoted to making sure that they do get pointed out: scientists. The scientific establishment has plenty of flaws in its reasoning, but it is, by design, self correcting. I don't think it's laziness to allow people who have devoted their entire lives to work out fantastically complicated problems to do their work without polluting the debate with my generally uninformed opinion. That way, not only do they get to do their work, I can focus on doing mine.
Re:Trust Me, I'm a Scientist by Alex3917 on Thursday May 05, 2011 @10:38AM (#2517511)
"science does change because flaws in research do eventually get pointed out."

No argument there, but that doesn't mean that it wasn't wrong to begin with.

"I don't think it's laziness to allow people who have devoted their entire lives to work out fantastically complicated problems to do their work without polluting the debate with my generally uninformed opinion."

Of course you shouldn't express your opinion if you're uninformed. But you also shouldn't put science on a pedestal. Writing your own literature review might not be feasible for most people, but deciding which of two factions (if not both) is full of shit doesn't take a whole lot of talent.

Re:Trust Me, I'm a Scientist by tel on Thursday May 05, 2011 @10:59AM (#2517596)
Assuming, as the lay scientific rhetoric often positions, that one of the two sides is full of shit!

In real scientific debate, the two sides are actually likely to be sharing an enormous amount of common ground and quibbling over extraordinarily specific details. The trick is that sometimes these specific details have an enormous impact (bistability). It doesn't suddenly mean that one side is full of shit just because the world might change dramatically depending on how that tiny detail changes.

Re:Trust Me, I'm a Scientist by bugsy on Thursday May 05, 2011 @11:06AM (#2517638)
Why shouldn't people express their opinion if they are uninformed?

Since the greatest experts in each field publish their best results with a less than 50% accuracy rate, it seems clear that uninformed people randomly guessing things can do better by flipping coins.

Feynman found it useful to go with his gut feeling about something before he had reviewed any previous research in a field, and found this worked well for him. His IQ was 125 so he's just an ordinary guy with common sense.

Re:Trust Me, I'm a Scientist by syllogism on Thursday May 05, 2011 @07:55PM (#2519410)
Feynman just an ordinary guy with common sense?

If his IQ was measured to be 125, that tells us far more about the accuracy of the IQ measurement process than Feynman's intelligence. Feynman's extra-ordinariness is on clear display.

Re:Trust Me, I'm a Scientist by rauljara on Thursday May 05, 2011 @11:01AM (#2517618)
If overturning established ideas is as easy for you as you seem to portray it, you should enter into a career in science. Scientists who can prove that existing paradigms are wrong, or incomplete, are treated as rock-stars, not pariahs. Virtually every scientific figure you have ever read about overturned some old false knowledge.

However, the reason there aren't more rock-stars like that is because when you actually have to inject yourself into the debate and have your own ideas exposed to the same level of skepticism, you often find that your own conclusions are as flawed as the ones you are critiquing.

Not saying science has all the answers. Not saying currently held beliefs won't be overturned. Not even saying that you might not be right about some of the things you are skeptical about. But I have seen a lot of people believe they know better about things of a scientific nature who have absolutely no idea about which they speak. As an outsider to think that something is easier than it is, and that you know more than you really know. It is not unreasonable to let the people whose life is devoted to the work, do their work. When you question smart people's life work, it is incredibly reasonable to apply some of the same skepticism you are applying to them to yourself.

Re:Trust Me, I'm a Scientist by Alex3917 on Thursday May 05, 2011 @11:22AM (#2517699)
"Scientists who can prove that existing paradigms are wrong, or incomplete, are treated as rock-stars, not pariahs."

I think people like to tell themselves this, but rarely is it actually true. If that's how humans actually worked then Michael Moore would have been canonized as a saint for showing that the Iraq war was a mistake.

At best the person who gets the credit is the person who used their clout to convince people that the old paradigm was wrong, not the person who actually did the analysis. And more commonly people begrudgingly accept the new model and no one gets credit, and even then they often don't accept the new model for dozens (or hundreds) of years after the evidence is in.