News for hackers. Stuff that matters.

A comment on VkFFT – Vulkan Fast Fourier Transform Library. Parent comment

Re:VkFFT – Vulkan Fast Fourier Transform Library by singhrac on Sunday September 27, 2020 @09:35PM (#24612027)
I've heard credible claims that GPUs these days (esp. TPUs) have lower latency for big models than CPUs. I haven't really investigated, but I could see it happening if you give the TPU a huge L1 cache or something.
[ Parent | on HN ]
Re:VkFFT – Vulkan Fast Fourier Transform Library by someguydave on Sunday September 27, 2020 @09:45PM (#24612105)
Perhaps for large calculations? Otherwise the PCI transfer delay would be a big latency hit?
[ Parent | on HN ]
Re:VkFFT – Vulkan Fast Fourier Transform Library by adamnemecek on Sunday September 27, 2020 @09:58PM (#24612188)
Yeah until TPUs can directly communicate with the sound card, it sounds slow.
[ Parent | on HN ]