Re:Nvidia, ASML Plunge as DeepSeek Triggers Tech Stock Selloff
by aurareturn on Tuesday January 28, 2025 @02:46AM
(#42849876)
>How exactly? From what I’ve read the full model can run on MacBook M1 sort of hardware just fine.
No you can't. Unless you run their 1.5b model quantized. Almost useless.
Their full model, Deepseek V3 has 671B parameters. Not even remotely close to being able to run well on consumer hardware.
Re:Nvidia, ASML Plunge as DeepSeek Triggers Tech Stock Selloff
by michaelscott on Tuesday January 28, 2025 @03:16AM
(#42850035)
Only the distilled models can run on everyday machines, not the full model
How exactly? From what I’ve read the full model can run on MacBook M1 sort of hardware just fine. And this is their first release, I’d expect it to get more efficient and maybe domain specific models can be run on much lower grade hardware sort of raspberry pi sort.