News for hackers. Stuff that matters.

A comment on Why train when you can optimize?. Parent comment

Re:Why train when you can optimize? by PartiallyTyped on Saturday April 30, 2022 @02:22AM (#31213830)
You may be interested in [1] where they go to a great extend to show that the convolution operation that we consider in DL is the dual of fourier series [2].

[1] https://geometricdeeplearning.com

[2] https://arxiv.org/pdf/2104.13478.pdf page 27 (23 if you count book pages).

[ Parent | on HN ]
Re:Why train when you can optimize? by amelius on Saturday April 30, 2022 @08:00AM (#31215357)
Is convolution in DL not implemented with the FFT as the underlying workhorse?
[ Parent | on HN ]
Re:Why train when you can optimize? by PartiallyTyped on Saturday April 30, 2022 @09:41AM (#31216013)
Probably no since FFT is slower and less parallelizable than products.
[ Parent | on HN ]