News for hackers. Stuff that matters.
Re:Any Deep ReLU Network Is Shallow by blt on Friday June 23, 2023 @07:19PM (#36453575)
The result in the paper is not an approximation result. The shallow network is of bounded width and is exactly equal to the deep one.
Re:Any Deep ReLU Network Is Shallow by elcomet on Friday June 23, 2023 @09:29PM (#36454520)
Only for relu networks though, which are already piecewise linear functions.