News for hackers. Stuff that matters.
Re:Show HN: Can I run this LLM? (locally) by reaperman on Saturday March 08, 2025 @07:41PM (#43305000)
It says “smaller distilled model” in your own quote which, generously, also implies quantized.

Here[0] are some 1.5B and 8B distilled+quantized derivatives of DeepSeek. However, I don’t find a 7B model, that seems totally made-up from whole cloth. Also, I personally wouldn’t call this 8B model “DeepSeek”.

0: https://www.reddit.com/r/LocalLLaMA/comments/1iskrsp/quantiz...

There are no comments on this comment yet.