News for hackers. Stuff that matters.
Re:Any Deep ReLU Network Is Shallow by throwawaymaths on Friday June 23, 2023 @06:38PM (#36453146)
this is the "universal approximator theorem".

https://cognitivemedium.com/magic_paper/assets/Hornik.pdf

> infinite number of [activations]

I don't think you need an infinite number of them, there is a relationship between "how close you want to get" and "how many of them you need".

There are no comments on this comment yet.