Re:Variational Inference for Machine Learning [pdf]
by marmaduke on Monday November 07, 2016 @06:36AM
(#12890320)
I came across the examples in the repo and commented on
https://github.com/blei-lab/edward/issues/211
so I'll try to do my homework before asking more questions ;)
I have also a naïve question: why not use the graphical structure of the model itself to add structure to the covariance? For example, in an AR model, each time point places prior on the next time point, so why not assume a banded covariance? More generally, one could use a cutoff on shortest path length (through the model's graphic structure) between parameters to decide if they should have nonzero coefficients.