News for hackers. Stuff that matters.
Re:DeepSeek gives Europe's tech firms a chance to catch up by deoxykev on Monday February 03, 2025 @06:38AM (#42917208)
My take: the distills under 32B aren’t worth running. Quants seem to impact quality much more than other models. 32B and 70B unquantized are very good. 671B is SOTA.
Re:DeepSeek gives Europe's tech firms a chance to catch up by rom16384 on Monday February 03, 2025 @10:11AM (#42918929)
In my own tests even the 70B distill has an unacceptably high rate of hallucinations that makes it hard to trust the results.