Re:macOS 26.2 enables fast AI clusters with RDMA over Thunde...
by monster_truck on Friday December 12, 2025 @06:25PM
(#46250295)
Even if it wasn't outright beneficial for decoding by itself, it would still allow you to connect a second machine running a smaller, more heavily quantized version of the model for speculative decoding which can net you >4x without quality loss
[ Parent
| on HN ]
There are no comments on this comment yet.