News for hackers. Stuff that matters.
Re:macOS 26.2 enables fast AI clusters with RDMA over Thunde... by monster_truck on Friday December 12, 2025 @06:25PM (#46250295)
Even if it wasn't outright beneficial for decoding by itself, it would still allow you to connect a second machine running a smaller, more heavily quantized version of the model for speculative decoding which can net you >4x without quality loss

There are no comments on this comment yet.