News for hackers. Stuff that matters.

A comment on Any Deep ReLU Network Is Shallow.

Re:Any Deep ReLU Network Is Shallow by spencerchubb on Friday June 23, 2023 @07:28PM (#36453638)
Does this result explicitly not hold for other activation functions, or have they just not explored it yet?
[ Parent | on HN ]
Re:Any Deep ReLU Network Is Shallow by gqcwwjtg on Friday June 23, 2023 @07:31PM (#36453658)
It seems like it doesn’t hold since this relies on turning the whole thing into a piecewise linear function.
[ Parent | on HN ]