News for hackers. Stuff that matters.
Re:Introduction to Modern Statistics by noelwelsh on Thursday October 12, 2023 @05:16AM (#37854994)
Statistics education is undergoing a bit of a revolution, driven by the accessibility of computers. For example, hypothesis testing is introduced by randomization[1], using a randomized permutation test[2]. I find this really easy to understand, compared to how I learned statistics using a more traditional approach. The traditional approach taught be a cookbook of hypothesis tests to use: use the t-test in this situation, use the chi-squared in this situation, and so on. I never gained any understanding of why I should use these different tests, or where they came from, from the cookbook approach.

For the same approach in a slightly different context see [3].

[1]: https://openintro-ims2.netlify.app/11-foundations-randomizat...

[2]: https://en.wikipedia.org/wiki/Permutation_test

[3]: https://inferentialthinking.com/chapters/11/1/Assessing_a_Mo...

Re:Introduction to Modern Statistics by iTokio on Thursday October 12, 2023 @07:32AM (#37855812)
There is also Brillant that has a very polished interactive course:

https://brilliant.org/courses/statistics/

Re:Introduction to Modern Statistics by usgroup on Thursday October 12, 2023 @07:47AM (#37855932)
These things are great if they add value for you, but I would be very skeptical of any non-mathematical approach to statistics. I think statistics is only made clear by mathematics, much the same as Physics. And one cannot grasp statistics without being able to understand the maths.

I think that still the best way to understand statistics is to start with the mathematical theory and to grind 1000+ textbook problems.

Re:Introduction to Modern Statistics by mkl on Thursday October 12, 2023 @08:29AM (#37856263)
> I think that still the best way to understand statistics is to start with the mathematical theory and to grind 1000+ textbook problems.

Are there any books you'd recommend for this approach?

Re:Introduction to Modern Statistics by usgroup on Thursday October 12, 2023 @09:52AM (#37857129)
My grind was "Mathematical Statistics with Applications" by Wackerly et al. There are PDF versions if you Google for it. I can't say it was quick, easy or intuitive; but it works.

I also liked "In all Likelihood" by Pawitan for a "likelihoodist" foundational approach.

Re:Introduction to Modern Statistics by jph00 on Friday October 13, 2023 @12:47AM (#37866803)
I was introduced to statistics with the mathematical approach, and it failed to help me understand why things were the way they were, due to the lack of context and application.

Later I re-learned it in an applied way, and things made much more sense to me.

(That's fine if you liked learning it your way, but that's no reason to be skeptical about other approaches.)

Re:Introduction to Modern Statistics by usgroup on Thursday October 12, 2023 @07:43AM (#37855896)
I've had similar thoughts, but I think its more to do with what is in your head at the time you hear about it. I found permutation tests satisfying to learn about because they somehow helped consolidate what I knew from distribution theory. If I didn't know any distribution theory prior, I'm not sure they could have that effect.

If you study mathematical statistics, it is not taught as a cookbook. At the elementary level you learn probability theory and distribution theory, all the different distributions, hypothesis tests, regression, ANOVA and so on proceed from there. Meanwhile, I think research scientists are often taught statistics as a set of recipes because its usually a short course for a specific discipline. E.g. Statistics for biologists.

Re:Introduction to Modern Statistics by ImaCake on Thursday October 12, 2023 @08:16AM (#37856140)
I think those short courses would be more effective if they didn't bother with ANOVA and instead taught intro probability and distributions and then jumped straight to regression. ANOVA is just a really specific way of doing a regression.

In R, and python::statsmodels you get the answer to (essentially) an ANOVA any time you run an LM or GLM; its the Z-statistic for your whole model.

I know there is more nuance to this, but teaching students that they can use regression for most of the problems they would have used seemingly arcane tests for is going to be much more useful for the students.

Here is a lovely page demonstrating how to do this in R: https://lindeloev.github.io/tests-as-linear/

Re:Introduction to Modern Statistics by usgroup on Thursday October 12, 2023 @10:00AM (#37857255)
I agree with the sentiment although I'm not sure there is the time for all of it. At least when I took them, probability theory and distribution theory were separate semester long courses, and the former was a prerequisite for the latter.
Re:Introduction to Modern Statistics by gpderetta on Thursday October 12, 2023 @10:49AM (#37857992)
Stastsmodels and that github page are the only reason I have some understanding of statistical tests.
Re:Introduction to Modern Statistics by bunderbunder on Thursday October 12, 2023 @11:21AM (#37858475)
Principles of Statistics by M.G. Bulmer is a nice introduction to the mathematical side of things. It's part of Dover's classic textbook series, so it's inexpensive compared to newer textbooks, and also concise and well-written.

It does assume you already have a solid understanding of calculus and combinatorics, though. Which I think is fair. Discrete statistics is arguably just applied combinatorics, and continuous statistics applied calculus, so if you have a strong foundation in those two subjects then you're already 90% of the way there. (And, if you don't, stop the cart and let the horse catch up.)

Re:Introduction to Modern Statistics by dr_dshiv on Thursday October 12, 2023 @08:50AM (#37856459)
Do you know of any validation studies with Advanced Data Analysis (formerly code interpreter) in chatGPT? I think it can be excellent as a teaching tool.
Re:Introduction to Modern Statistics by wespiser_2018 on Thursday October 12, 2023 @12:23PM (#37859342)
The difficulty of teaching statistics is that the maths you need to prove things are right and gain an intuitive understanding of the methods are far more advanced than what is presented in a basic stats course. Gosset came up with the t-test and proved to the world it made sense, yet we teach students to apply it in a black box way without a fundamental understanding of why it's right. That's not great pedagogy.

IMO, this is where Bayesian Statistics is far superior. There's a Curry-Howard isomorphism to logic which runs extremely deep, and it's possible to introduce using conjugate distributions with nice closed form analytical solutions. Anything more complex, well, that's what computers are for, and there are great ways (STAN) to run complex distributions that are far more intricate than frequentist methods.

Re:Introduction to Modern Statistics by zozbot234 on Thursday October 12, 2023 @12:55PM (#37859772)
Maximum likelihood (which underpins many frequentist methods) basically amounts to Bayesian statistics with a uniform prior on your parameters. And the "shape" of your prior actually depends on the chosen parametrization, so in principle you can account for non-flat priors as well.
Re:Introduction to Modern Statistics by nextos on Thursday October 12, 2023 @01:22PM (#37860092)
IMHO, the discussion should not be so much whether to teach Bayesian or maximum likelihood. But instead, whether to teach generative models or to keep going with hypothesis tests, which are generally presented to students as a bag of tricks.

Generative models, (implemented in e.g. Stan, PyMC, Pyro, Turing, etc.) split models from inference. So one can switch from maximum likelihood to variational inference or MCMC quite easily.

Generative models, beginning from regression, make a lot more sense to students and yield much more robust inference. Most people I know who publish research articles on a frequent basis do not know p-values are not a measure of effect sizes. This demonstrates current education has failed.

Re:Introduction to Modern Statistics by eutectic on Thursday October 12, 2023 @04:17PM (#37862630)
Maximum Likelihood corresponds to Bayesian statistics with MAP estimation, which is not the typical way to use the posterior.
Re:Introduction to Modern Statistics by thefringthing on Thursday October 12, 2023 @03:59PM (#37862385)
> There's a Curry-Howard isomorphism [between] logic [and Bayesian statistical inference].

This is an odd way of putting it. I think it's better to say that, given some mostly uncontroversial assumptions, if one is willing to assign real number degrees of belief to uncertain claims, then Bayesian statistical inference is the only way of reasoning about those claims that's compatible with classical propositional logic.

Re:Introduction to Modern Statistics by mmplxx on Friday October 13, 2023 @08:35PM (#37877063)
The will to assign real numbers to degrees of belief is the controversial assumption. Converted bayesians tend to gloss over this fact. Many, as in a sibling comment, state that MLE is bayesian statistics with a uniform prior, but this isn't true of most if not all frequentist inference, based on frequentist NHT and CI, not MAP. Modeling uncertainty with uniform priors (or even more sophisticated non-informative priors a la Jaynes) is a recipe for paradoxes and there is no alternative practical proposal that I know of. I have no issue with bayesian modeling in a ML context of model selection and validation based on resampling methods, but IMO it's not up to the foundational claims its proponents often do.
Re:Introduction to Modern Statistics by zaptheimpaler on Friday October 13, 2023 @01:43AM (#37867114)
Hey i recognized you from the Scala doodle project! that and the other stuff from Underscore was a really cool way to learn Scala & FP, thank you :)
Re:Introduction to Modern Statistics by noelwelsh on Friday October 13, 2023 @02:09AM (#37867282)
That's very random but very cool! I'm glad the books were useful to you :-) This post was actually motivated by my wanting to write some material on data science, wondering what the modern approach to teaching it is, and falling down a rabbit hole.
Re:Introduction to Modern Statistics by cbolton on Friday October 13, 2023 @05:11AM (#37868498)
I think a common way to teach classical statistics is to start with a binomial test. The binomial distribution is quite concrete so the students can hopefully grasp the concept of p-value. Then things become more abstract with the normal, T distribution, etc. and cookbook of when to use what...