News for hackers. Stuff that matters.
Re:Why Do Neural Networks Need an Activation Function? by ml_thoughts on Monday July 01, 2019 @12:08AM (#20322392)
The posted article isn't particularly fascinating, but for a bit of fun, there's an OpenAI project where they demonstrate that due to the non-linear rounding of Float32 values you can actually train "non-linear" linear networks: https://openai.com/blog/nonlinear-computation-in-linear-netw...
Re:Why Do Neural Networks Need an Activation Function? by p1esk on Monday July 01, 2019 @11:28AM (#20326306)
Or any binarized or ternarized network.