News for hackers. Stuff that matters.

A comment on An evaluation of throughput computing on CPU and GPU (2010) [pdf]. Parent comment

Re:An evaluation of throughput computing on CPU and GPU (201... by hughperkins on Monday September 05, 2016 @08:02AM (#12429680)
have you actually tried writing highly optimizer cuda? its really hard. nothing is "for free". a lot of the caching (not all) has to be hand coded. you can see how much attention to detail scott gray puts into his kernels eg at https://github.com/NervanaSystems/maxas
[ Parent | on HN ]
Re:An evaluation of throughput computing on CPU and GPU (201... by jacquesm on Monday September 05, 2016 @08:45AM (#12429878)
Not that much harder than writing hand optimized assembly.

There are a few more quirks to keep in mind and you need to have the memory lay-out and access patterns down otherwise it will not give you the boost you expect.

In a way I really love CUDA for this reason, it allows me to re-cycle all my old optimization skills and do something useful with them.

[ Parent | on HN ]