Re:Making a neural network say “I Don’t Know”: Bayesian NNs ...
by mmm1111 on Friday November 30, 2018 @12:21PM
(#18570628)
the author of this article would do well to admit that he "doesn't know" bayesian inference very well. unfortunately, the usage of pyro is incorrect here. in particular data subsampling is handled incorrectly (there may be more issues). the weights of the network represent a global random variable. consequently, when doing data-subsampling care must be taken that the ELBO that is constructed is scaled correctly. that is not done here. probabilistic programming languages like pyro are a great tool for making bayesian inference easier and more accessible, but they can be produce arbitrarily bad results if the user uses them incorrectly.
[ Parent
| on HN ]
Re:Making a neural network say “I Don’t Know”: Bayesian NNs ...
by jlmaccal on Monday December 03, 2018 @11:35AM
(#18590074)
Could you elaborate on how to do this correctly? This is one of the only examples of using pyro to build a Bayesian NN and it would be really valuable have a correct implementation.