News for hackers. Stuff that matters.
Re:Variational Inference for Machine Learning [pdf] by marmaduke on Friday November 04, 2016 @04:53AM (#12871161)
> you need to start storing Hessians

aren't there methods for online sparse estimates of the Hessian?

I'd expect a lot of "large" problems for which RMC is useful would have sparse structures.

> ideal sampler would be able to reason about the distribution as program

Are you a developer of Stan? If not, you might be interested.

http://mc-stan.org

_edit_ by online estimate of a Hessian, I meant online numerical approximation based on the sequence of Jacobians.

Re:Variational Inference for Machine Learning [pdf] by jmalicki on Friday November 04, 2016 @09:22AM (#12872297)
"An L-BFGS like version of Riemannian MC, to get rid of the Hessians." - that's what he said
Re:Variational Inference for Machine Learning [pdf] by murbard2 on Friday November 04, 2016 @12:55PM (#12874020)
I'm not a developer of Stan, but I know many of them and I'm a fan of the project in general.