News for hackers. Stuff that matters.

A comment on Kolmogorov Neural Networks can represent discontinuous functions. Parent comment

Re:Kolmogorov Neural Networks can represent discontinuous fu... by ubj on Sunday November 05, 2023 @02:46PM (#38154883)
If an appropriate dual problem is found this could be possible.

I'm baffled why Mert Pilanci's work in this area hasn't received more attention. His proofs of a zero duality gap for neural networks are impressive.

[ Parent | on HN ]
Re:Kolmogorov Neural Networks can represent discontinuous fu... by smaddox on Sunday November 05, 2023 @05:39PM (#38156415)
Well, the approach currently doesn't apply to architectures being used in practice, and it's not clear, at least to me, if it can scale to large datasets.
[ Parent | on HN ]
Re:Kolmogorov Neural Networks can represent discontinuous fu... by ubj on Sunday November 05, 2023 @10:08PM (#38158343)
Fair points. But given the potential impact this would have in practice, I'm still surprised there isn't more interest in exploring whether it's possible to scale the approach. Transforming neural network training into convex formulations would drastically simplify many current difficulties.
[ Parent | on HN ]