News for hackers. Stuff that matters.

A comment on Building a simple neural net in Java. Parent comment

Re:Building a simple neural net in Java by SomeHacker44 on Sunday December 20, 2020 @01:08PM (#25488210)
It only works because of non-linearities. So that seems like too much of a simplification, limiting it to "linear algebra" when it involves both vector calculus and non-linear algebras.
[ Parent | on HN ]
Re:Building a simple neural net in Java by mjburgess on Sunday December 20, 2020 @01:23PM (#25488334)
In principle. In practice, the "ReLU Algebra" is almost a linear algebra.

NN solutions end up being discontinuous stacks of linear regressions.

So it's not a bad place to start in explaining NNs. ReLU NN models are piece-wise linear.

[ Parent | on HN ]