Re:Apple's MLX adding CUDA support
by tonyarkles on Monday July 14, 2025 @07:56PM
(#44566586)
They sure do and it's pretty amazing. One iteration of a vision system I worked on got frames from a camera over a Mellanox NIC that supports RDMA (Rivermax), preprocessed the images using CUDA, did inference on them with TensorRT, and the first time a single byte of the inference pipeline hit the CPU itself was when we were consuming the output.
[ Parent
| on HN ]
There are no comments on this comment yet.