News for hackers. Stuff that matters.
Re:DeepSeek-R1 with Dynamic 1.58-bit Quantization by Gracana on Tuesday January 28, 2025 @08:58AM (#42852345)
Maybe that's what they meant, and it'd be cool if nvidia still offered that on consumer cards, but thankfully you don't need it for LLM inference. The traffic between cards is very small.
Re:DeepSeek-R1 with Dynamic 1.58-bit Quantization by diggan on Tuesday January 28, 2025 @09:22AM (#42852592)
Isn't the issue that the software needs to explicitly add support for it now, compared to yester-yesterday when you could just treat them as one in software?