Re:Pyro: The Universal, Probablistic Programming Language
by esafak on Friday July 28, 2023 @06:08PM
(#36914011)
These things go in and out of fashion. Now it's LLMs' turn to have their fifteen minutes.
I think one reason why Bayesian models have not taken off is that representing prediction uncertainty comes at the expense of accuracy, for a given model size. People prefer to devote model capacity to reducing the bias rather than modeling uncertainty.
Bayesian models make more sense in the small-data regime, where uncertainty looms large.
I think one reason why Bayesian models have not taken off is that representing prediction uncertainty comes at the expense of accuracy, for a given model size. People prefer to devote model capacity to reducing the bias rather than modeling uncertainty.
Bayesian models make more sense in the small-data regime, where uncertainty looms large.