News for hackers. Stuff that matters.
Re:Neural Networks, Types, and Functional Programming by frigaardj on Thursday September 03, 2015 @03:43PM (#10167088)
It seems like the author has realised that there are a few common functional programming patterns (folds, maps) that are also common ways of combining information and operating on data structures, and seen the parallel to some operations that we frequently want to do within neural networks. A 'function' is simply a thing that takes another thing and produces a third thing. This doesn't seem that revolutionary or insightful - do these ideas give us any extra knowledge about neural networks or is this just a nice parallel?
Re:Neural Networks, Types, and Functional Programming by jeremysalwen on Thursday September 03, 2015 @04:13PM (#10167245)
I think that the theory is pretty much already clear to people who have a lot of experience with neural networks. I think the contribution is to explicitly write it down in a clear and concise way for people who it wouldn't have otherwise occurred to.
Re:Neural Networks, Types, and Functional Programming by frigaardj on Thursday September 03, 2015 @04:21PM (#10167303)
Fair enough.
Re:Neural Networks, Types, and Functional Programming by noelwelsh on Thursday September 03, 2015 @04:09PM (#10167226)
If this formalism works out then a few interesting directions spring to mind:

- we suddenly have a huge new toolbox from FP / category theory that we can apply to understanding and extending DNNs. E.g. what happens if we apply differentiation in the manner of zippers to these structures? I have no idea but it might lead somewhere.

- The deep learning world gets a precise way to describe network architecture which makes communication much easier and research much more reproducible.

- With a formal model you can automate building and optimising implementations.

Re:Neural Networks, Types, and Functional Programming by ajtulloch on Thursday September 03, 2015 @06:17PM (#10167841)
https://github.com/ajtulloch/dnngraph is an application of these ideas - it's a Haskell DSL for building DNNs for later execution by Caffe/Torch.