News for hackers. Stuff that matters.
Re:An Elementary Introduction to Information Geometry [pdf] by amirkdv on Wednesday September 30, 2020 @09:57PM (#24646436)
That's indeed mathematically very exciting and reason enough to study IG.

But does IG allow us to reason about Neural Nets in new ways that could move the needle on open questions about information representation in ANNs or, even better, BNNs?

Re:An Elementary Introduction to Information Geometry [pdf] by antixk on Wednesday September 30, 2020 @10:56PM (#24646819)
Good question. Most people are focussing on the natural gradient and making it as efficient as SGD. But some have been exploring if we can introduce inductive bias in the function space rather than the weight space, using IG. But it is still quite a new field.
Re:An Elementary Introduction to Information Geometry [pdf] by ogogmad on Thursday October 01, 2020 @03:53AM (#24648489)
BNNs?
Re:An Elementary Introduction to Information Geometry [pdf] by jmt_ on Thursday October 01, 2020 @08:55AM (#24650295)
They're distinguishing between artificial neural networks(ANN) and biological neural networks(BNN)