News for hackers. Stuff that matters.

A comment on Any Deep ReLU Network Is Shallow. Parent comment

Re:Any Deep ReLU Network Is Shallow by uoaei on Saturday June 24, 2023 @02:39AM (#36456190)
It would be very surprising if this result was relevant for transformers considering the softmax that's present there.
[ Parent | on HN ]
Re:Any Deep ReLU Network Is Shallow by visarga on Saturday June 24, 2023 @04:36AM (#36456753)
true
[ Parent | on HN ]