News for hackers. Stuff that matters.
Re:Scientists rise up against statistical significance by BucketSort on Wednesday March 20, 2019 @05:49PM (#19447335)
It's funny because statisticians are among the loudest critics of how easily statistics can be abused. I encourage you not to be turned away from a whole field because one bad representative. Professors are humans too and say a lot of dumb things. Very few are their field incarnate.
Re:Scientists rise up against statistical significance by jrochkind1 on Wednesday March 20, 2019 @06:32PM (#19447685)
STATISTICIANS actually do fine, generally. The problem is that no statisticians were involved in the analysis and write-up of almost all research that isn't statistics papers.

The statistics just don't mean what most scientists think/write they mean. They're using em wrong. As the OP explains some manners of, in fairly technical language.

Re:Scientists rise up against statistical significance by emgee_1 on Wednesday March 20, 2019 @06:48PM (#19447779)
Statisticians are doing fine indeed. The problem lies entirely in the ( non) design of experiments ( DoE) of the “scientists”. The sorry state of affairs of graduates from universities in properly designing experiments in which proper randomization, focus on sources of variability, between groups and within groups is not understood nor accounted for in the design is the true source of the problem. Scientists should always consult a statistician when undertaking an experiment. At least if they would like to make/draw sensible conclusions.
Re:Scientists rise up against statistical significance by BucketSort on Wednesday March 20, 2019 @06:45PM (#19447764)
Yes, I was just saying along with OP that a statistician would be most critical of the professor's reasoning. It's like a tyrant saying you should take a class in morals when you raise an objection to their atrocities.
Re:Scientists rise up against statistical significance by EGreg on Wednesday March 20, 2019 @06:08PM (#19447489)
What do Bayesians say these days btw?

I still find Bayes to be more grounded and less “pie in the sky” than frequentists.

Re:Scientists rise up against statistical significance by pas on Wednesday March 20, 2019 @06:16PM (#19447554)
It all depends on your priors what they say. :)

But seriously, you can have the most pathological prior distribution, so you can then stick with it forever. (Let's say your prior predestines you to always find that whatever the new piece of data you get is so unlikely that it's more likely that it's an error/conspiracy than a real piece of data that you have to do belief update on.)

So, instead of coming up with a significance level, you have to estimate the chance of observing a null result, which determines how much new data moves your posterior distribution. The "advantage" of the Bayesian approach is that - in theory - you can incorporate every tiny little bit of data into your model (distribution). The disadvantage is, that it's very susceptible to various biases (through a biased prior).

Re:Scientists rise up against statistical significance by skj on Wednesday March 20, 2019 @09:18PM (#19448524)
Bayesian statistics are mathematically perfect, as long as your priors are true. Unfortunately, they are not.
Re:Scientists rise up against statistical significance by EGreg on Thursday March 21, 2019 @09:56AM (#19452356)
I think it’s the opposite. Your confidence intervals are only true if your distribution is true. But how can it be that perfect? At least Bayesians adjust their knowledge like scientists.