News for hackers. Stuff that matters.
Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by api on Wednesday January 29, 2025 @11:28AM (#42867105)
It's not great at super-complex tasks due to limited context, but it's quite a good "junior intern that has memorized the Internet." Local deepseek-r1 on my laptop (M1 w/64GiB RAM) can answer about any question I can throw at it... as long as it's not something on China's censored list. :)
Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by azinman2 on Wednesday January 29, 2025 @03:09PM (#42870461)
How are you running r1 on 64mb of ram? I’m guessing you’re running a distill which is not r1
Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by api on Wednesday January 29, 2025 @06:01PM (#42872449)
The 70b distill at 4bit quantize fits, so yes, and performance and quality seem pretty good. I can't run the gigantic one.
Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by azinman2 on Friday January 31, 2025 @01:13AM (#42885092)
Ok but that’s not deepseek-r1. Lots of people keep saying this for distills and it’s getting very confusing.