In particular, I love how commenters on HN will unhesitatingly dismiss any peer-reviewed, published scientific paper with a dismissive sneer, and the comment that "correlation doesn't equal causation," as if they were the only people on earth to whom this axiom had been communicated, and that the scientific establishment was completely unaware of statistics, untrained in even the most basic aspects of hypothesis testing.
Obviously there are examples in the other direction as well, but I dont see it as a common problem on HN.
Also its worth noting, that the more difficult it is to grasp the subject matter of a paper, the less likely it is that peer reviewers are actually reviewing it any better than a common reader. Evidenced by the multitude of papers in the recent past that have been discredited as academically dishonest to fraud, and the hilarious meta-studies slipping computer generated gibberish through journal review processes.
Sorry, but no.
Papers are reviewed by researchers who are intimately familiar with the subject and techniques used in the paper under review. Journal editors don't give papers to people who are incapable of reviewing them. That would be dumb.
"...evidenced by the multitude of papers in the recent past that have been discredited as academically dishonest to fraud, and the hilarious meta-studies slipping computer generated gibberish through journal review processes."
You're exaggerating. Out of the thousands and thousands of peer-reviewed articles that are published each year, a small handful are later shown to be fraudulent. Overall, peer review has a pretty great track record.
I was exaggerating, and for the most part respected journals are of high quality. That does not necessarily have anything to do with the review process. I tend to believe it has more to do with the character of those who choose to do such research (without other significant monetary motivations than the long-shot that what they're working on may produce marketable results).
Regardless, I would not suggest that the review process is not useful and necessary, as it is the best system we have, and works well for the most part given the dynamics of the system it exists in. I simply wanted to point out that it is very far from perfect or provably reliable (I'd argue most academically dishonest research slips through as not notable enough to warrant particular scrutiny anyway and fades into obscurity without question) and that it is vulnerable to gaming by sufficiently knowledgeable people.
Well, that got me off topic without even being the main thrust of my original post. Hit a nerve and started rambling. apologies if my comments came out more critical than I actually feel.
The problem (which I agree exists) arrives when people fail to realize that even extremely rapid conversion of intelligence to knowledge does not make you an expert in many fields without years of fairly dedicated study.
Example: "What if we launched an orbital rocket from a balloon? Do the math, guy, what that saves you isn't worth the effort. You're not open to my ingenious new idea!"
^_^
Hackers should focus on hacking and be more humble when treading on unknown territory, imho.
HOW to BECOME a GOOD THEORETICAL PHYSICIST
by Gerard 't Hooft
This is a web site (still under construction) for young students - and anyone else - who are (like me) thrilled by the challenges posed by real science, and who are - like me - determined to use their brains to discover new things about the physical world that we are living in. In short, it is for all those who decided to study theoretical physics, in their own time.
http://www.phys.uu.nl/~thooft/theorist.html
See also:
Herring Brain Box http://large.stanford.edu/herring/brain/
It is no joke. Nobel laureate in physics t'Hooft wrote the page to give serious advice to people who aspire to understand theoretical physics.
An anecdote, FWIW ;)
Once Pierre Deligne, and few fellow mathematicians, annoyed at their utter lack of understanding of QFT and involved physics, decided to sit down for a year and learn some. Notes they've took during that year of effort are now a standard reference (http://www.amazon.com/Quantum-Fields-Strings-Course-Mathemat...)
For subjects with depth, this is wrong. And I think that's part of the reason why HN discussions of many subjects with some depth (politics, finance, economics, legal issues, and so on) often seem shallow. I'm not an expert in any of those areas, and maybe my judgement is wrong. But I am an expert in the physical sciences, and Matt's post looks pretty spot on as a diagnosis of what's wrong with some of the HN threads related to the physical sciences.
None of this is to say that HN isn't still a great forum. But it remains at its best on the subject of startups and (to a lesser extent) related technical subjects.