Re:We Made CUDA Optimization Suck Less
by jaberjaber23 on Thursday May 15, 2025 @11:59AM
(#43996379)
Do you have a place where we can chat? Linkedin,....
Sorry, I'm not the CUDA expert you should be looking for. My efforts are in ML and I only dabble in CUDA and am friends with systems people. I'd suggest reaching out to system people.
I'd suggest you use that NVIDIA connection and reach out to the HPC teams there. Anyone working on CUTLASS, TensorRT, cuTensor, or maybe event the CuPy team could give you a lot better advice than me.
Re:We Made CUDA Optimization Suck Less
by jaberjaber23 on Thursday May 15, 2025 @05:23PM
(#43999470)
I really appreciate that!! thanks:D
I get that you profile. I liked that part. But even as the other commenter says, it's unclear how to evaluate given the examples. Showing some real examples would be critical to sell people on this. Idk, maybe people blindly buy too but personally I'd be worried about integrating significant tech debt. It's easy to do that with kernels or anytime you're close to the metal. The nuances dominate these domains