Re:GPUs for Deep Learning in 2023 – An In-depth Analysis
by touisteur on Wednesday January 18, 2023 @04:26PM
(#34433314)
Well every since I've read these papers doing FFTs faster than cuFFT using tensor cores (although FFT isn't supposed to be helped by more flops but only better memory bandwidth) and also fp32-level accuracy on convolutions with 3x tf32 tensor cores sweeps (available in cutlass) I'm quite ready to believe some hype about TMA.
Anything improving memory bandwidth for any compute part of the GPU is welcome.
Also I'd like for someone to crack open RT cores and get the ray-triangle intersection acceleration out of Optics. Have you seen the FLOPS on these things?
Re:GPUs for Deep Learning in 2023 – An In-depth Analysis
by touisteur on Thursday January 19, 2023 @05:12AM
(#34438652)
Before I forget, here's the link to the tcFFT paper https://ar5iv.labs.arxiv.org/html/2104.11471v1
And the fp32-gemm-with-tf32 https://arxiv.org/abs/2203.03341
I think TMA may not matter as much for consumer cards given the disproportionate amount of fp32 / int32 compute that they have.
Would be interesting to see how close to theoretical folks are able to get once CUDA support comes through.