News for hackers. Stuff that matters.

A comment on Speeding up PyTorch inference on Apple devices with AI-generated Metal kernels. Parent comment

Re:Speeding up PyTorch inference on Apple devices with AI-ge... by yieldcrv on Wednesday September 03, 2025 @08:24PM (#45121957)
> Yes, of course the model with custom kernels is faster, whether it's written by a human or an AI.

But that’s the thing, I wouldn’t write a custom kernel before AI

I don't do that level of development or operate at that part of the stack but I’m very experienced in software development

AI significantly augments my skillsets in this area

[ Parent | on HN ]
Re:Speeding up PyTorch inference on Apple devices with AI-ge... by am17an on Thursday September 04, 2025 @02:01AM (#45124047)
The point is those kernels exist already, you can just use them off the shelf. In the case where you're trying to write a production grade kernel without operating at that part of the stack... well good luck with that.
[ Parent | on HN ]