Re:An Elementary Introduction to Information Geometry [pdf]
by antixk on Wednesday September 30, 2020 @10:56PM
(#24646819)
Good question. Most people are focussing on the natural gradient and making it as efficient as SGD. But some have been exploring if we can introduce inductive bias in the function space rather than the weight space, using IG. But it is still quite a new field.
But does IG allow us to reason about Neural Nets in new ways that could move the needle on open questions about information representation in ANNs or, even better, BNNs?