News for hackers. Stuff that matters.

A comment on Computer scientists prove why bigger neural networks do better. Parent comment

Re:Computer scientists prove why bigger neural networks do b... by throwaway5486nv on Friday February 11, 2022 @09:29AM (#30301849)
My understanding is more than the density configuration of the neurons matters most. The reason is in some cases neural network with drop out's perform better than fully connected neural network. This proves less dense networks can be more intelligent.
[ Parent | on HN ]
Re:Computer scientists prove why bigger neural networks do b... by thesz on Sunday February 13, 2022 @12:09AM (#30319415)
>This proves less dense networks can be more intelligent.

Case in point: https://openai.com/blog/block-sparse-gpu-kernels/

[ Parent | on HN ]