News for hackers. Stuff that matters.
Re:Using Libc for GPUs by nickysielicki on Saturday December 14, 2024 @04:23PM (#42419546)
genuinely asking: where else should ML engineers focus their time, if not on looking at datapath bottlenecks in either kernel execution or the networking stack?
Re:Using Libc for GPUs by lmm on Saturday December 14, 2024 @08:40PM (#42420828)
The point is that you should focus on the bottlenecks, not on making every random piece of code "as fast as possible". And that sometimes other things (maintainability, comprehensibility, debuggability) are more important than maximum possible performance, even on the GPU.
Re:Using Libc for GPUs by nickysielicki on Saturday December 14, 2024 @09:27PM (#42421026)
That's fair, but I didn't understand OP to be claiming above that "cudaheads" aren't looking at their performance bottlenecks before driving work, just that they're looking at the problem incorrectly (and eg: maybe should prioritize redesigns over squeezing perf out of flawed approaches.)