News for hackers. Stuff that matters.
Re:Bayesians Moving from Defense to Offense by mjfl on Saturday December 23, 2023 @01:00PM (#38746375)
I've never heard anyone promote frequentist statistics. I've only ever heard Bayesians on the 'offense' talking about why their framework is better. To be clear I am someone who doesn't really understand the faultlines.
Re:Bayesians Moving from Defense to Offense by travisjungroth on Saturday December 23, 2023 @01:37PM (#38746739)
Frequentist is the default. People don’t promote it. They just teach it as statistics, use p-values, and look funny at anyone who does otherwise.

It’s like how you wouldn’t hear people in the US promote imperial measurements for home baking. When you dominate, you don’t have to advocate.

Re:Bayesians Moving from Defense to Offense by analog31 on Saturday December 23, 2023 @01:57PM (#38746953)
I'd identify a larger problem, which is teaching anything as a bunch of recipes.

My college offered stats in two tracks: There was a one-semester course for science majors, which was mostly plugging numbers into formulas. The course was utterly baffling for most of the students who took it.

There was also a two-semester course for math majors. It was mainly about proofs, but also had time to go into more depth. You have to know the assumptions underlying a formula, if you're expected to prove it. ;-) But it was only taken by the math majors.

Re:Bayesians Moving from Defense to Offense by dan-robertson on Saturday December 23, 2023 @07:31PM (#38749772)
I’m not sure that teaching mathstats more broadly is the answer to frequentist approaches being used by default, or to the recipe problem. I did the whole mathstats thing as a student and spent a bunch of time doing calculus around things like maximum likelihood estimators or unbiased estimators. I don’t think it’s very useful for the application of statistics in practice. I would recommend Statistical Rethinking by Richard McElreath as a course in Bayesian statistics targeted at scientists who want to extract correct, useful conclusions from their experiments, which doesn’t follow the “recipe book” pattern.
Re:Bayesians Moving from Defense to Offense by analog31 on Saturday December 23, 2023 @09:17PM (#38750468)
I'm not sure of that either. For one thing, the students would be blown away.

One thing we didn't have when I took stats was computers. I graduated from high school in 1982, and the colleges in my state were just beginning to get computers. I wonder if stats could be approached differently if it could start with nothing but data -- lots of it -- and graphing tools. This could even happen pre-college.

Re:Bayesians Moving from Defense to Offense by lmpdev on Sunday December 24, 2023 @06:58AM (#38752925)
I don’t know if it’s the “answer”, but it followed a pretty simple logistic curve for our curriculum at uni

First course was almost purely frequentist

Second was half and half with several weeks approaching the frequentist bayesian approach from both sides

Our third stats course was mostly bayesian though self directed as to which point of view was “most appropriate” for the formulated problem sets. I remember roughly half the cohort used a frequentist perspective on a fairly obvious (but not explicit) bayesian assignment and were severely punished by the course coordinator (fairly for a late year subject tbh)

Re:Bayesians Moving from Defense to Offense by mjfl on Saturday December 23, 2023 @03:00PM (#38747598)
But I don't see p-values as connected to frequentist statistics. Rather, p-values are a concept that applies to the problem of hypothesis testing, which both frequentist and bayesian statistics should apply to, right? And in both cases you would use a p-value. The unique thing that Bayesian statistics can do is fit parameters can calculate uncertainty in those parameters, which does not contradict any of the concepts of hypothesis testing.
Re:Bayesians Moving from Defense to Offense by travisjungroth on Saturday December 23, 2023 @03:30PM (#38747898)
A p-value is the frequency you’d expect to see a sample with an effect this size or greater, given the null hypothesis. It’s inherently a frequentist approach to inference.

You can squish it into Bayes by considering it a uniform prior on the real number line that you never update, but you’re not really doing things “in the spirit” of Bayes, then.

Re:Bayesians Moving from Defense to Offense by mjfl on Saturday December 23, 2023 @04:34PM (#38748449)
What is a “prior” in the context of hypothesis testing? That seems to me to be a concept used in parameter estimation, with Bayes rule. But hypothesis testing is not parameter estimation.
Re:Bayesians Moving from Defense to Offense by PheonixPharts on Saturday December 23, 2023 @05:25PM (#38748902)
In Bayesian terms there is no distinction between hypothesis testing and parameter estimation.

If your hypothesis is that A is greater than B, then you're test boils down to "The probability that A is greater than B", which is arrived at through parameter estimation via Bayes' Theorem.

You can consider the distribution of estimates for a parameter to represent a space of possible hypothesis for the true value of that parameter and their absolutely or relative likelihood based on the information available.

The also has the pleasant consequence that hypothesis testing using Bayesian methods nearly always is closer to the actual question someone wants to answer rather than replying with confusing statements such as "the probability of rejecting the null hypothesis", which contains an implicit double negative.

Re:Bayesians Moving from Defense to Offense by mjfl on Saturday December 23, 2023 @10:53PM (#38750951)
> If your hypothesis is that A is greater than B, then you're test boils down to "The probability that A is greater than B", which is arrived at through parameter estimation via Bayes' Theorem.

but even in this situation you would need a threshold for decision making, i.e. a p-value.

Re:Bayesians Moving from Defense to Offense by uoaei on Sunday December 24, 2023 @12:17AM (#38751337)
"p-value" as a term already has a definition -- one that imposes a frequentist perspective -- so you'd have to come up with a new term to define a Bayesian analogue of that concept.
Re:Bayesians Moving from Defense to Offense by mjfl on Sunday December 24, 2023 @01:43AM (#38751661)
I fail to understand why the terminology matters. If you need to make a decision then there will be a threshold in the probability that will determine it. It doesn’t matter if you call it p values or anything else.
Re:Bayesians Moving from Defense to Offense by uoaei on Sunday December 24, 2023 @02:34AM (#38751883)
I'm not understanding your confusion. Different concepts require different words to distinguish them in conversation. p-value is a name, not merely a descriptor, of one possible way to define a threshold. Other ways of defining thresholds get different names so that everyone knows what's being discussed.

Bob bob bob'bob bob bob bob bob, bob bob bob bob bob "Bob".

Re:Bayesians Moving from Defense to Offense by PheonixPharts on Sunday December 24, 2023 @05:10PM (#38757430)
I'm curious how much professional statistical experience you have? In my experience probabilities alone are very rarely used and distributions of beliefs are combined with distributions of value so you can choose optimal risk/reward scenarios.

Bayesian decision making typically involves combining a cost function with your posterior distribution.

It's worth pointing out that this is typically not possible in most frequentist frameworks since they work in double negative style assertions and arbitrary threshold rather than modeling the problem itself.

While you can map Bayesian approaches to frequentists tests, this is usually a misunderstanding of Bayesian methods coming from a purely frequentist background. Bayesian analysis is fundamentally more flexible since it just the application of the sum and product rules (you don't even need Bayes' theorem since it can be trivially derived from these) as well as corresponding cost/value functions.

Re:Bayesians Moving from Defense to Offense by PheonixPharts on Sunday December 24, 2023 @05:06PM (#38757396)
I know this reply is a bit late, but, at least in my professional experience, Bayesian decision making typically does not involve just a probability of an event (in which thresholds are more or less arbitrary, including p-values) but involves mapping the probably to a cost/value in which the threshold isn't determined by arbitrary probability threshold but died to business value.

In the most common situations this typically means the expected value well exceeds the expected cost and you're comfortable with the risk if you're wrong.

Re:Bayesians Moving from Defense to Offense by travisjungroth on Saturday December 23, 2023 @05:16PM (#38748825)
As the linked post points out, you can regularize a p-value based on prior experiments.

IMO, null hypothesis testing is way overused. We should be quantifying the comparison of the null versus alternative hypotheses. People already compare them. Might as well bring some math into it.

Re:Bayesians Moving from Defense to Offense by mitthrowaway2 on Saturday December 23, 2023 @05:18PM (#38748848)
How is hypothesis testing different from parameter estimation? They seem conceptually the same to me, with one a special case of the other.
Re:Bayesians Moving from Defense to Offense by stale2002 on Saturday December 23, 2023 @06:52PM (#38749496)
> What is a “prior” in the context of hypothesis testing?

A prior could be any previous knowledge that you have on the subject, or anything about the world.

Let me give you a silly example. Imagine I do an experiment, on if person A can see the future, and predict coin flips.

Now, imagine that I do this experiment, and lo and behold it passes the 5% threshold P value!

Remember what a P value is. It is simply the percent chance that the results that you got were by chance.

So, if I do that experiment, and it actually gets at the "P value" of 5%, which means that there is a 5% chance of it happening by chance, do you know believe that Person A can see the future?

I wouldn't. I would need a much lower P value to start believing that.

Thats all a prior is. It is using the fact that "Person A can see the future!" is an extraordinary claim. And for that, we require extraordinary evidence. Much better evidence than a mere "5% that it happened by chance". P

Re:Bayesians Moving from Defense to Offense by tingletech on Saturday December 23, 2023 @04:46PM (#38748550)
I think with a Bayesian test one would use credible intervals rather than p values?
Re:Bayesians Moving from Defense to Offense by PheonixPharts on Saturday December 23, 2023 @05:31PM (#38748941)
> But I don't see p-values as connected to frequentist statistics.

P-values are fundamentally Frequentist because this framework see that observed data as random, whereas Bayesian statistics believe our observations are the only thing that is actually known, and all the other parameters are what is random in our experiments. That is: the data is the only part of an experiment that is real, everything else that we can't directly observe is something we must hypothesize about.

Re:Bayesians Moving from Defense to Offense by zozbot234 on Saturday December 23, 2023 @01:18PM (#38746548)
Frequentist statistics is largely based on the maximum likelihood principle, which is a proper Bayesian analysis whenever the prior is a flat distribution. And since inference is mostly done on model parameters in frequentist statistics, the distribution you assume for them will also depend on how you parameterize the model. So it can often be justified as a convenient approximation to a "properly" Bayesian result.
Re:Bayesians Moving from Defense to Offense by jdewerd on Saturday December 23, 2023 @01:25PM (#38746597)
I've probably heard 1000 Bayesians rant about the alleged Frequentist consensus and 0 Frequentists complain about Bayesian analysis. I'd need some pretty steep priors to interpret this as anything other than the academic equivalent of "one WEIRD trick THEY don't want you to know" marketing.
Re:Bayesians Moving from Defense to Offense by exe34 on Saturday December 23, 2023 @02:37PM (#38747370)
Every single statistics class I've ever taken or been sent to has been 95% frequentist with a rushed Bayesian digression near the end. I've submitted papers with Bayesian work and the reviewer asked for p-values and would not budge. I gave him his bloody p-values, because I could not afford not to get the paper published that early in my career.
Re:Bayesians Moving from Defense to Offense by jdewerd on Saturday December 23, 2023 @02:55PM (#38747530)
There's always a more complicated model.
Re:Bayesians Moving from Defense to Offense by zozbot234 on Saturday December 23, 2023 @03:05PM (#38747649)
The "more complicated" version of frequentist statistics is called robust statistics. There's most likely a way to rephrase your favorite Bayesian analysis so as to make it fully kosher from a "robust+frequentist" point of view, even keeping the math unchanged. It just goes to show how silly the "controversy" is.
Re:Bayesians Moving from Defense to Offense by PheonixPharts on Saturday December 23, 2023 @05:32PM (#38748951)
Bayesian statistics is fundamentally less complicated than Frequentist statistics since everything can be derived from a very simple set of first principles, rather than complex frameworks of ad hoc testing methodologies.
Re:Bayesians Moving from Defense to Offense by ivan_ah on Sunday December 24, 2023 @12:02PM (#38754795)
> Bayesian statistics is fundamentally less complicated than Frequentist statistics [...]

I broadly agree with you, but I'm wondering if you would reconsider your qualification as "less complicated" if you consider beginner learners. E.g. someone who knows basic descriptive statistics and probability theory, and is making first contact with inferential statistics. Specifically, assume a learner who knows what an integral is, but is far from proficient with it (UGRAD student, not a GRAD student).

I was reading this paper[1] recently, which highlights two difficulties of teaching Bayesian stats: 1) the mathematical complexity of understanding conditional probability distributions, and 2) the lack of well defined, broadly accepted conventions for what priors to use in specific data analysis scenarios.

I think a computational approach to prob theory could mitigate 1), but 2) remains a problem—the freedom to choose priors, is also a burden...

[1] https://www.stat.purdue.edu/~dsmoore/articles/BayesPedagogy....

Re:Bayesians Moving from Defense to Offense by ivan_ah on Sunday December 24, 2023 @12:29PM (#38754996)
For context, I'm not taking sides in the frequentist-vs-Bayesian debate, but coming from a practical problem: I'm working on a INTRO TO STATS book right now, and I would like to include a chapter on Bayesian statistics, but I'm not sure what specific analyses to showcase and recommend as "standard" approaches. Unlike the canonical t-tests and ANOVAs of frequentists, Bayesian statistics doesn't have canonical procedures (that I know of) that I can wholeheartedly recommend as "must know" and ready to use broadly.

Maybe someone here might have suggestions?

The closest thing that comes to mind is "Bayes factors," which has some traction (usage), but apparently they have lots of problems and limitations too, cf. https://www.youtube.com/watch?v=MqeWpR6S4XA

Re:Bayesians Moving from Defense to Offense by maltelau on Monday December 25, 2023 @04:27PM (#38766286)
Maybe you would find it useful to read a textbook on bayesian stats for inspiration. I can recommend Richard McElreath's "Statistical Rethinking" which makes it very clear how inflexible it is to just know recipes like t-tests or anovas.

The canonical approach is to build a generative model with a parameter (or multiple for ~anova) that codes for the difference between groups and do inference on that parameter of interest. Most of the recipes taught in statistics classes can be modelled as a regression of some kind (this counts for frequentist stats too, see https://lindeloev.github.io/tests-as-linear/ ). Some advocate to do that inference with bayes factors. Others, like discussed elsewhere in this thread, advocate combining the resulting posterior with a cost/value function, but either way the lesson is that there is less focus on "t-test-vs-anova" because they're the same thing anyways.

Re:Bayesians Moving from Defense to Offense by ivan_ah on Tuesday December 26, 2023 @09:01PM (#38778274)
Thanks for the "Statistical Rethinking" recommendation. I had watched some of McElreath's lectures so I knew of the book, but next year I think I'm finally going to read it from end to end and follow along the 2024 course schedule: https://github.com/rmcelreath/stat_rethinking_2024#calendar-...

I had previously started the BDA course, which is another famous Bayesian course, see https://avehtari.github.io/BDA_course_Aalto/ but I didn't finish it due to travel.

No more excuses in 2024... time to level-up the Bayesian modelling skill ;)

Re:Bayesians Moving from Defense to Offense by throwawaymaths on Saturday December 23, 2023 @02:26PM (#38747250)
There's always room for a first time.

Bayesian statistics is sound but I suspect it's often just used to justify biases. It is technically valid to use a prior and de facto never update it, because you know I'll get around to updating my prior next week, or... eventually, cough cough let's be honest, never

Re:Bayesians Moving from Defense to Offense by marcosdumay on Saturday December 23, 2023 @04:05PM (#38748228)
Bayesian statistics is the one where you must state your bias explicitly, and justify them one by one under the light.

It's the frequentist one that gets your biases implicitly, on the form of corrections and hypothesis formulation, so that people don't notice them.

Re:Bayesians Moving from Defense to Offense by derbOac on Saturday December 23, 2023 @07:12PM (#38749629)
I don't know. I've published Bayesian methodology papers and reviewed them and although I might call myself an objective Bayesianist maybe, Bayesianism has its own implicit biases. In the very least, I think it can take advantage of implicit biases people have in interpreting analyses.

One issue is that Bayes estimates are almost always produced, even if no information is coming from empirical data, and all the information is coming from a prior. So it's possible to produce results heavily influenced by the prior with Bayesian estimation that with frequentist methods would fail completely because of lack of identification of the model, sending a strong signal that something is wrong. This can all be sussed out with Bayesian methods but people often don't do it.

Another more subtle issue is people aren't quite aware of how a prior can deviate from "maximal conservativism". Sometimes, for example, depending on the model, a very flat prior is actually not conservative, and is overweighting tails.

There's other examples too. Basically, yes, Bayesianism forces you to be explicit with your biases, but people are really bad at interpreting the actual impact of those biases in a formal Bayesian framework, or at least, aren't any better at it than with frequentist methods that are available.

If you approach statistical inference from the perspective of accuracy (as the linked paper seems to do) Bayesianism is better to the extent the priors are accurate. This is true a lot of the time empirically, but it does lead to a kind of tautology, in that you're doing the analysis because you don't really know what "truth" is. So if you're right in your priors, Bayesianism is accurate, but then you didn't really need new data as much in the first place; if you're wrong, it's more biased. Basically in the bias-variance tradeoff, Bayesianism makes a bet on reduced variance assuming that the resulting bias will be small enough.

Philosophically, though, there's a completely different argument, which is one of competitive fairness. You might say this doesn't matter, but consider consequential decisions, like hiring or admissions decisions: if someone was making a prediction about you, would you want them to use a strong prior, or something that's maximally conservative and fair?

This philosophy leads to frequentism basically.

My preference is to be maximally conservative in a Bayesian framework, which leads to reference priors, which are often flat in many canonical situations, which is basically frequentism. In other situations you might have a different kind of prior.

To me the linked paper is pretty interesting and makes a good point. On the other hand, I'd rather not make any assumptions about a new result based on past studies on other effects. I'd rather just collect lots of diverse real data and meta-analyze it. There's no substitute for data -- and that includes priors.

Re:Bayesians Moving from Defense to Offense by light_hue_1 on Saturday December 23, 2023 @04:21PM (#38748355)
Yes, because Frequentists won a long time ago. And are responsible for producing garbage science ever since.

Of course the winners don't rant about anything. But any time we probe the consequences of Frequentist statistics they turn out to be horrific for science, our health, and our planet.

Re:Bayesians Moving from Defense to Offense by therobots927 on Monday December 25, 2023 @09:11AM (#38762733)
How so? What’s an example of that?
Re:Bayesians Moving from Defense to Offense by paulsutter on Saturday December 23, 2023 @02:12PM (#38747118)
If we were allowed one super-upvote per month, I would use mine right now on your comment
Re:Bayesians Moving from Defense to Offense by selimthegrim on Saturday December 23, 2023 @02:56PM (#38747552)
Dang is going to file this under the Bumble model of HN monetization in his desk drawer
Re:Bayesians Moving from Defense to Offense by causality0 on Saturday December 23, 2023 @03:28PM (#38747879)
There are times I'd be willing to pay a fiver to un-flag my comment.
Re:Bayesians Moving from Defense to Offense by jowea on Saturday December 23, 2023 @05:43PM (#38749036)
Or just HN Gold
Re:Bayesians Moving from Defense to Offense by abecedarius on Saturday December 23, 2023 @11:06PM (#38751012)
The frequentist ranting was concentrated around a century ago +/- one lifetime, and they called the enemy "inverse probability" (when being polite).
Re:Bayesians Moving from Defense to Offense by kgwgk on Monday December 25, 2023 @05:31PM (#38766853)
"Inverse probability" is just what statistical inference was called before frequentist ideas were introduced. It was in the second half of the last century when the "Bayesian" label was introduced - amusingly in opposition to the much newer "classical" methods.
Re:Bayesians Moving from Defense to Offense by Avshalom on Saturday December 23, 2023 @02:21PM (#38747202)
It's worth pointing out that the vast majority of "Bayesians" you see talking shit have no actual training in bayesian statistics, or any statistics training beyond the college-intro level.
Re:Bayesians Moving from Defense to Offense by mapmeld on Saturday December 23, 2023 @01:38PM (#38746752)
I went to a week-long Probabilistic AI seminar, and I got the impression there was an era when enough stats and math professors did not take a Bayesian framework seriously, that there was a risk someone's thesis or dissertation defense would be derailed by someone on faculty.
Re:Bayesians Moving from Defense to Offense by SpaceManNabs on Saturday December 23, 2023 @01:18PM (#38746545)
> I've never heard anyone promote frequentist statistics

I will do it:

1. Computationally easier

2. often analytical theory available for most use cases so interpretability is high

3. more literature available so you can get unstuck faster if you mess up

4. no accusations of subjective bias in your prior (the con is clear, no ability to leverage subjective expertise)

5. In the asymptotic regime, MLE and bayesian MAP often converge anyways

6. king of hypothesis testing

For most people, it doesn't matter. It matters when you are doing treatment for small sample sizes or other situations that would cause low power.

Re:Bayesians Moving from Defense to Offense by bogtog on Saturday December 23, 2023 @02:03PM (#38747030)
> king of hypothesis testing

This advantage can't be understated. Researchers, at least in psychology, almost never seem to care about the magnitude of an effect. It's simply enough to show that some effect happens in some direction. For this (generally acceptable) purpose, frequentist stats are great.

Re:Bayesians Moving from Defense to Offense by urschrei on Saturday December 23, 2023 @02:31PM (#38747309)
A statistically significant result without something like a Hedges G (or Cohens D if comparing means) measure would be called out by even a moderately attentive reviewer as a matter of course (especially if small sample sizes are involved), and many reputable journals actually require effect sizes to be stated, so you run the risk of being desk rejected for leaving it out.
Re:Bayesians Moving from Defense to Offense by nullc on Saturday December 23, 2023 @07:22PM (#38749701)
For leaving it out perhaps, but the result is publishable even if the effect is small... where for significant you usually must p-hack your way to a standard threshold.

It's not entirely unreasonable, as often extra variables suppress the effect size. E.g. the effect is substantial in people with some genetics, insignificant otherwise. The fact that there is an effect at all makes it interesting as a starting point for further exploration e.g. to determine the mechanism or find the extra factors needed to make the effect significant.

Re:Bayesians Moving from Defense to Offense by travisjungroth on Saturday December 23, 2023 @02:33PM (#38747333)
Add some sampling bias, a significance threshold of 0.05. Baby, you’ve got a replication crisis going!
Re:Bayesians Moving from Defense to Offense by naasking on Saturday December 23, 2023 @06:30PM (#38749356)
> This advantage can't be understated. Researchers, at least in psychology, almost never seem to care about the magnitude of an effect. It's simply enough to show that some effect happens in some direction

That's not an advantage, that's one of the primary reasons psychology is among the worst subjects hit by the replication crisis.

Re:Bayesians Moving from Defense to Offense by SubiculumCode on Sunday December 24, 2023 @01:10AM (#38751538)
A cheap shot that misunderstands the so called "crisis" in psychology, which almost comes entirely from the fact that brains are non randomly exchangeable, unique, samples differ, the brain is complex, multiple ways to solve problems, and sussing it all out is complex as hell.
Re:Bayesians Moving from Defense to Offense by naasking on Sunday December 24, 2023 @01:38AM (#38751640)
If they are at least as knowledgeable as you, who correctly describes how messy you can expect the data to be, then you should be more concerned with effect size, because small effects are almost certainly just "noise". Instead, sensationalism about miniscule effects that vanish on replication attempts abound.

So not a cheap shot at all IMO.

Re:Bayesians Moving from Defense to Offense by bogtog on Saturday December 30, 2023 @01:50PM (#38817722)
Sorry for this very slow response, but I actually disagree. I don’t think effect sizes are usually meaningful beyond the context of a specific experiment.

For example, suppose you are researching the effect of an emotional/negative picture on how a participant makes decision in an economic game. Here, you may think “a big effect size implies this study will have a large practical relevance.” However, following typical statistical designs, an effect size may be largely determined by just how many trials the experiment used for each participant. This is also not the only factor that’s relevant. For instance, it’s debatable how the emotion induced in the task compares to the intensity of real life emotional situations. With these factors in mind, the effect size really doesn’t tell you much that can be applied outside the laboratory.

Maybe in some non-experimental sub-fields (e.g. personality psychology) effect sizes are more meaningful…

Re:Bayesians Moving from Defense to Offense by analog31 on Saturday December 23, 2023 @01:10PM (#38746473)
Indeed, when I took statistics in college, nearly 40 years ago, we proved Bayes theorem, and worked through several applications, so it could hardly have been regarded as controversial.
Re:Bayesians Moving from Defense to Offense by tnecniv on Saturday December 23, 2023 @02:28PM (#38747274)
Bayes theorem is fairly elementary probability. It isn’t the part that is questioned in Bayesian statistics. Someone disagreeing with Bayes theorem would be like disagreeing with addition.

The controversial part is the methodology for statistical analysis built on top of it (e.g., you need a prior but where did that come from?)

Re:Bayesians Moving from Defense to Offense by winwang on Saturday December 23, 2023 @06:28PM (#38749347)
Priors come from the barrel of a gun :P
Re:Bayesians Moving from Defense to Offense by Tomte on Saturday December 23, 2023 @03:26PM (#38747858)
Bayes theorem shares a name with Bayesianism, but it is not specific to it. No frequentist would question Bayes theorem, it is on the level of 1+1=2.
Re:Bayesians Moving from Defense to Offense by adastra22 on Saturday December 23, 2023 @01:24PM (#38746587)
It’s not. Statistics is statistics. This controversy is new and contrived.
Re:Bayesians Moving from Defense to Offense by jvans on Saturday December 23, 2023 @02:42PM (#38747419)
The controversy is decades old and largely resolved. Both methods work well on large enough data sets, Bayesian methods are far superior on small datasets
Re:Bayesians Moving from Defense to Offense by adastra22 on Saturday December 23, 2023 @05:36PM (#38748981)
This statement doesn’t really make sense to me. A frequentist approach assumes a random (or noisy) underlying process and characterizes its probability. A Bayesian approach assumes a fixed but unknown process and updates the probability a given model matches that reality.

It is ultimately the same math, if you are comparing apples to apples. Just different ways of looking at a problem. Sometimes one is better suited than the other.

It’s like as if physicists were arguing over whether Cartesian or Polar coordinates were better. It’s the same damn physics, just expressed differently. In some problems one approach is easier to work with than the other, and can even make seemingly intractable problems solvable. But that doesn’t mean the other approach was “wrong.”

Re:Bayesians Moving from Defense to Offense by jvans on Saturday December 23, 2023 @06:05PM (#38749206)
In many cases yes. A simple example where this is not true is if your populations have different variances. T tests are no longer valid but heterogenous variances can be modeled with a Bayesian approach
Re:Bayesians Moving from Defense to Offense by fbdab103 on Saturday December 23, 2023 @01:57PM (#38746967)
Tell that to Ronald Fisher, who made it a point to deride Bayesian stats wherever there was an opportunity.
Re:Bayesians Moving from Defense to Offense by terminous on Saturday December 23, 2023 @07:49PM (#38749915)
> I've never heard anyone promote frequentist statistics.

At least in my undergrad education, I took two dedicated statistics classes and many more domain science classes that used statistics, all of which were so steeped in the frequentist paradigm that frequentist vs Bayesian wasn't even mentioned. Frequentist statistics simply was statistics for me, until grad school.