Re:Most Reported Genetic Associations with Intelligence are ...
by btilly on Tuesday October 08, 2013 @03:04PM
(#6517098)
Multiple hypothesis testing is built into the design of the studies, and has been from the very start. When it comes to proper interpretation of stats in science, geneticists are at the top of the hierarchy.
It is built into the design of the studies. But studies that do not find results do not get published. Thus there is a lot of room for exceptional results to sneak through despite the attempts to get the stats right.
Re:Most Reported Genetic Associations with Intelligence are ...
by epistasis on Tuesday October 08, 2013 @10:02PM
(#6519034)
GWAS studies are extremely expensive studies, often in the hundreds of thousands of dollars in SNP chips alone, and will get published somewhere, somehow. If they don't find results they get published in lesser journals, because there's always something to be said even if there are not significant associations.
It's the same with academic clinical trials, even negative results get published, because for those academics they still need something to show, and a publication of a negative result is better than nothing.
Non-publication bias is more common in less expensive, more exploratory settings, where there are lots of little experiments going on all the time. This is quite different from GWAS.
The scientifically interesting thing is that it's not at all like that XKCD cartoon. Multiple hypothesis testing is built into the design of the studies, and has been from the very start. When it comes to proper interpretation of stats in science, geneticists are at the top of the hierarchy.
Your second point is far closer to what I think is going on, but I still think that single-gene studies are the wrong way to go, as you might guess from my username. They're testing for the wrong thing, single locus or single gene causes, of a very complex phenotype with the involvement of many many different loci and genes. So if there are 500-600 genes that are important, maybe one passes the test in your particular subsample, but in a different subsample the rest of the 500-600 genes mediate the effect. I.e. there's not enough complexity in the model to account for the signal. What's worked very well for simple diseases and traits may not work well for complex traits with the influence of many many different genes.