News for hackers. Stuff that matters.
Re:Ggml.ai joins Hugging Face to ensure the long-term progre... by liuliu on Friday February 20, 2026 @03:36PM (#47093575)
Depending on what you do. If you are doing token generations, compute-dense kernel optimization is less interesting (as, it is memory-bounded) than latency optimizations else where (data transfers, kernel invocations etc). And for these, Mac devices actually have a leg than CUDA kernels (as pretty much Metal shaders pipelines are optimized for latencies (a.k.a. games) while CUDA shaders are not (until cudagraph introduction, and of course there are other issues).

There are no comments on this comment yet.