News for hackers. Stuff that matters.
Re:DeepSeek's AI breakthrough bypasses industry-standard CUD... by Cladode on Wednesday January 29, 2025 @05:17AM (#42863391)
> write their stuff in PTX

I wonder if you vould you point me to concrete examples where people write PTX rather than CUDA? I'm asking because I just learned CUDA since it's so much faster than Python!

Re:DeepSeek's AI breakthrough bypasses industry-standard CUD... by DiabloD3 on Wednesday January 29, 2025 @02:08PM (#42869605)
There isn't a lot of easily accessible examples outside of the corporate world.

Open source authors typically shy away from Nvidia closed source APIs, and PTX is tied to how Nvidia hardware works, so you won't see it implemented for other hardware.

To do what Deepseek did, but didn't want to waste your time and money with Nvidia, you'd use Vulkan. Theres more Vulkan in the world than CUDA.

Re:DeepSeek's AI breakthrough bypasses industry-standard CUD... by winwang on Friday January 31, 2025 @01:55AM (#42885240)
Here's a rather trivial example of using PTX: https://docs.nvidia.com/cuda/parallel-thread-execution/#spec...

For various micro-bench reasons I wanted to use a global clock instead of an SM-local one, and I believe this was needed. Also note that even CUDA has "lower level"-like operations, e.g. warp primitives. PTX itself is super easy to embed in it like asm.