Re:DeepSeek-R1 with Dynamic 1.58-bit Quantization
by Gracana on Tuesday January 28, 2025 @08:58AM
(#42852345)
Maybe that's what they meant, and it'd be cool if nvidia still offered that on consumer cards, but thankfully you don't need it for LLM inference. The traffic between cards is very small.
[ Parent
| on HN ]