News for hackers. Stuff that matters.
Re:Any Deep ReLU Network Is Shallow by hervature on Friday June 23, 2023 @07:36PM (#36453688)
I would just add the caveat that it is a single hidden layer. If you were to write this as a sequential model you would have something like:

nn.Sequential(

    Dense(many neurons),

    Dense(1)
)

From this, it's pretty easy to see it is "two" layers but also from your equation c_i and a_i denote two separate matrix multiplications.

There are no comments on this comment yet.