Freewire: An Experiment with Freely Wired Neural Networks

Re:Freewire: An Experiment with Freely Wired Neural Networks by mpoteat on Friday March 19, 2021 @05:59PM (#26518547)

If freely wired neutral networks are DAGs, I wonder how cyclic graphs of neurons behave, or even if that model would be theoretically meaningful, or computationally feasible.

[ Parent | on HN ]

Re:Freewire: An Experiment with Freely Wired Neural Networks by LeegleechN on Friday March 19, 2021 @06:03PM (#26518590)

Yep, they've existed for decades. Look up "RNN" (recurrent neural network) and "LSTM" (long stort-term memory). They were the standard for neural-network based time-series processing for a while until recently supplanted by Transformers.

[ Parent | on HN ]

Re:Freewire: An Experiment with Freely Wired Neural Networks by goldenkey on Friday March 19, 2021 @06:02PM (#26518576)

https://en.wikipedia.org/wiki/Boltzmann_machine

You generally run them until they settle down. You can train them, in a difficult process, by using the idea of thermal equilibrium.

[ Parent | on HN ]