News for hackers. Stuff that matters.

A comment on Any Deep ReLU Network Is Shallow.

Re:Any Deep ReLU Network Is Shallow by foota on Saturday June 24, 2023 @12:01AM (#36455419)
Another maybe silly thought, but if any relu network could be written in three layers, does this allow for a hyper efficient ReLu only hardware for ml where the pipeline is fixed?
[ Parent | on HN ]
Re:Any Deep ReLU Network Is Shallow by alok-g on Saturday June 24, 2023 @07:10AM (#36457587)
See these comments on the same post if not already.

https://news.ycombinator.com/item?id=36453136

Short answer to your question: Not true in general.

[ Parent | on HN ]