News for hackers. Stuff that matters.
Re:Apple's MLX adding CUDA support by ajuhasz on Monday July 14, 2025 @07:12PM (#44566370)
Re:Apple's MLX adding CUDA support by tonyarkles on Monday July 14, 2025 @07:56PM (#44566586)
They sure do and it's pretty amazing. One iteration of a vision system I worked on got frames from a camera over a Mellanox NIC that supports RDMA (Rivermax), preprocessed the images using CUDA, did inference on them with TensorRT, and the first time a single byte of the inference pipeline hit the CPU itself was when we were consuming the output.