News for hackers. Stuff that matters.

A comment on Why ML Needs a New Programming Language. Parent comment

Re:Why ML Needs a New Programming Language by almostgotcaught on Friday September 05, 2025 @03:42PM (#45142782)
> which are never, ever written in Python

nah never ever ever ever ever ... except

https://github.com/FlagOpen/FlagGems

https://github.com/linkedin/Liger-Kernel

https://github.com/meta-pytorch/applied-ai

https://github.com/gpu-mode/triton-index

https://github.com/AlibabaPAI/FLASHNN

https://github.com/unslothai/unsloth

the number of people commenting on this stuff that don't know what they're actually talking about grows by leaps and bounds every day...

[ Parent | on HN ]
Re:Why ML Needs a New Programming Language by Hizonner on Friday September 05, 2025 @04:43PM (#45143363)
I stand corrected. I should have known people would be doing that in Python.

How many of the world's total FLOPs are going through those?

[ Parent | on HN ]
Re:Why ML Needs a New Programming Language by almostgotcaught on Friday September 05, 2025 @06:17PM (#45144301)
Triton is a backend for PyTorch. Lately it is the backend. So it's definitely double digits percentage if not over 50%.
[ Parent | on HN ]
Re:Why ML Needs a New Programming Language by lairv on Friday September 05, 2025 @08:52PM (#45145514)
It's the backend for torch.compile, pytorch eager mode will still use cuBLAS/cuDNN/custom CUDA kernels, not sure what's the usage of torch.compile
[ Parent | on HN ]
Re:Why ML Needs a New Programming Language by almostgotcaught on Friday September 05, 2025 @10:10PM (#45145971)
> not sure what's the usage of torch.compile

consider that at minimum both FB and OAI themselves definitely make heavy use of the Triton backend in PyTorch.

[ Parent | on HN ]
Re:Why ML Needs a New Programming Language by cavisne on Saturday September 06, 2025 @02:37AM (#45147142)
Doesn’t triton write its own intermediate language that then compiles to PTX?
[ Parent | on HN ]
Re:Why ML Needs a New Programming Language by almostgotcaught on Saturday September 06, 2025 @05:08AM (#45147752)
Yes and?
[ Parent | on HN ]
Re:Why ML Needs a New Programming Language by saagarjha on Saturday September 06, 2025 @05:14AM (#45147783)
It has a fairly standard MLIR pipeline
[ Parent | on HN ]
Re:Why ML Needs a New Programming Language by saagarjha on Saturday September 06, 2025 @05:16AM (#45147790)
A lot. OpenAI uses Triton for their critical kernels. Meta has torch.compile using it too. I know Anthropic is not using Triton but I think their homegrown compiler is also Python. xAI is using CUTLASS which is C++ but I wouldn't be surprised if they start using the Python API moving forward.
[ Parent | on HN ]
Re:Why ML Needs a New Programming Language by almostgotcaught on Saturday September 06, 2025 @07:48AM (#45148453)
Anthropic is a Jax shop
[ Parent | on HN ]
Re:Why ML Needs a New Programming Language by saagarjha on Saturday September 06, 2025 @02:34PM (#45151753)
Surprised they got it working for Tranium
[ Parent | on HN ]