News for hackers. Stuff that matters.
Re:Variational Inference for Machine Learning [pdf] by murbard2 on Friday November 04, 2016 @07:37PM (#12877134)
Edit: ah never mind, variational inference, got it! I was thinking stochastic HMC!

---

Ok but that will get an unbiased estimate of the log-likelihood. MCMC or HMC do work with noisy estimators, but they require unbiased estimates of the likelihood.

At the very least, you need to do a convexity adjustment by measuring the variance inside your mini batch. Or you can use the Poisson technique which will get you unbiased estimates of exp(x) from unbiased estimates of x (albeit at the cost of introducing a lot of variance).

Re:Variational Inference for Machine Learning [pdf] by proditus on Sunday November 06, 2016 @08:35PM (#12888201)
great points; yes, the challenge becomes considerably more challenging with MCMC!