Re:Kimi K2 Thinking, a SOTA open-source trillion-parameter r...
by oxcidized on Friday November 07, 2025 @10:10PM
(#45853778)
Admittedly I've not tried running on system RAM often, but every time I've tried it's been abysmally slow (< 1 T/s) when I've tried on something like KoboldCPP or ollama. Is there any particular method required to run them faster? Or is it just "get faster RAM"? I fully admit my DDR3 system has quite slow RAM...
[ Parent
| on HN ]
There are no comments on this comment yet.